[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:42:19 dist-test-slave-2p8l krb5kdc[10551](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:42:19 dist-test-slave-2p8l krb5kdc[10551](info): set up 2 sockets
Aug 12 02:42:19 dist-test-slave-2p8l krb5kdc[10551](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 02:42:21.113633 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.356s user 0.004s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:42:21 dist-test-slave-2p8l krb5kdc[10551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502541, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:42:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:42:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:42:21.242162 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:35959
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:35959
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:21.360327 10575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:21.360750 10575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:21.360880 10575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:21.365082 10575 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:42:21.365170 10575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:21.365212 10575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:21.365250 10575 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:42:21.365288 10575 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:42:21.370919 10575 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:35959
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:35959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:21.371954 10575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:21.372968 10575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:21.382112 10583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:21.382373 10575 server_base.cc:1034] running on GCE node
W20260812 02:42:21.382213 10586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:21.384188 10584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:21.384768 10575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:21.385928 10575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:21.387121 10575 hybrid_clock.cc:648] HybridClock initialized: now 1786502541387090 us; error 61 us; skew 500 ppm
Aug 12 02:42:21 dist-test-slave-2p8l krb5kdc[10551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502541, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:21.390661 10575 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:42:21.391590 10575 webserver.cc:460] Webserver started at http://127.10.75.126:34357/ using document root <none> and password file <none>
I20260812 02:42:21.392158 10575 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:21.392251 10575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:21.392482 10575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:21.394872 10575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "e38c2a56b4eb4e439cd6eb83aff45e7d"
format_stamp: "Formatted at 2026-08-12 02:42:21 on dist-test-slave-2p8l"
server_key: "67bb454a12bcb6f3477e5a1b4d46bd86"
server_key_iv: "7f9104e3a527608bc303ee72b600951b"
server_key_version: "encryptionkey@0"
I20260812 02:42:21.395480 10575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "e38c2a56b4eb4e439cd6eb83aff45e7d"
format_stamp: "Formatted at 2026-08-12 02:42:21 on dist-test-slave-2p8l"
server_key: "67bb454a12bcb6f3477e5a1b4d46bd86"
server_key_iv: "7f9104e3a527608bc303ee72b600951b"
server_key_version: "encryptionkey@0"
I20260812 02:42:21.399709 10575 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 02:42:21.402308 10603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:21.403612 10575 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 02:42:21.403770 10575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "e38c2a56b4eb4e439cd6eb83aff45e7d"
format_stamp: "Formatted at 2026-08-12 02:42:21 on dist-test-slave-2p8l"
server_key: "67bb454a12bcb6f3477e5a1b4d46bd86"
server_key_iv: "7f9104e3a527608bc303ee72b600951b"
server_key_version: "encryptionkey@0"
I20260812 02:42:21.403893 10575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:21.430215 10575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:21.433363 10575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:21.433643 10575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:21.449365 10575 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:35959
I20260812 02:42:21.449461 10699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:35959 every 8 connection(s)
I20260812 02:42:21.450441 10575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:42:21.453229 10700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:21.459210 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 10575
I20260812 02:42:21.459388 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:42:21.459735 10700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d: Bootstrap starting.
I20260812 02:42:21.461458 10541 external_mini_cluster.cc:1428] Setting key 4d916f6038969cd96d547031676c97ac
I20260812 02:42:21.464159 10700 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:21.465626 10700 log.cc:824] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:21.468367 10700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d: No bootstrap required, opened a new log
I20260812 02:42:21.476157 10700 raft_consensus.cc:348] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e38c2a56b4eb4e439cd6eb83aff45e7d" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35959 } }
I20260812 02:42:21.476441 10700 raft_consensus.cc:374] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:21.476503 10700 raft_consensus.cc:729] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e38c2a56b4eb4e439cd6eb83aff45e7d, State: Initialized, Role: FOLLOWER
I20260812 02:42:21.477012 10700 consensus_queue.cc:260] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e38c2a56b4eb4e439cd6eb83aff45e7d" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35959 } }
I20260812 02:42:21.477200 10700 raft_consensus.cc:388] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:42:21.477277 10700 raft_consensus.cc:482] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:42:21.477387 10700 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:21.479079 10700 raft_consensus.cc:504] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e38c2a56b4eb4e439cd6eb83aff45e7d" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35959 } }
I20260812 02:42:21.479557 10700 leader_election.cc:302] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e38c2a56b4eb4e439cd6eb83aff45e7d; no voters:
I20260812 02:42:21.480005 10700 leader_election.cc:288] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:42:21.480237 10711 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:21.480644 10711 raft_consensus.cc:686] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d [term 1 LEADER]: Becoming Leader. State: Replica: e38c2a56b4eb4e439cd6eb83aff45e7d, State: Running, Role: LEADER
I20260812 02:42:21.481038 10711 consensus_queue.cc:237] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e38c2a56b4eb4e439cd6eb83aff45e7d" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35959 } }
I20260812 02:42:21.481505 10700 sys_catalog.cc:564] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:42:21.483618 10715 sys_catalog.cc:455] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e38c2a56b4eb4e439cd6eb83aff45e7d. Latest consensus state: current_term: 1 leader_uuid: "e38c2a56b4eb4e439cd6eb83aff45e7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e38c2a56b4eb4e439cd6eb83aff45e7d" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35959 } } }
I20260812 02:42:21.483896 10715 sys_catalog.cc:458] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:21.484133 10714 sys_catalog.cc:455] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e38c2a56b4eb4e439cd6eb83aff45e7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e38c2a56b4eb4e439cd6eb83aff45e7d" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35959 } } }
I20260812 02:42:21.484691 10714 sys_catalog.cc:458] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:21.485529 10727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:42:21.489369 10727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 02:42:21 dist-test-slave-2p8l krb5kdc[10551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502541, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:21.498131 10727 catalog_manager.cc:1347] Generated new cluster ID: 697d4fca6eb845d3b73eb975e6f4cb45
I20260812 02:42:21.498206 10727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:42:21.498883 10709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:21.465754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37280 (local address 127.10.75.126:35959)
0812 02:42:21.466454 (+ 700us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:21.466508 (+ 54us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:21.467684 (+ 1176us) server_negotiation.cc:407] Connection header received
0812 02:42:21.475750 (+ 8066us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:21.475771 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:21.476101 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:21.476378 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:21.480300 (+ 3922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:21.482517 (+ 2217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:21.484633 (+ 2116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:21.485844 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:21.486025 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:21.492267 (+ 6242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:21.492274 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:21.492291 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:21.492322 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:21.494767 (+ 2445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:21.495308 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:21.495315 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:21.495320 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:21.495437 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:21.495794 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:21.495797 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:21.495799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:21.496260 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:21.497222 (+ 962us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:21.497385 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 02:42:21.497688 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"spinlock_wait_cycles":59264,"thread_start_us":248,"threads_started":1}
I20260812 02:42:21.520712 10727 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:42:21.522166 10727 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:42:21.535926 10727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e38c2a56b4eb4e439cd6eb83aff45e7d: Generated new TSK 0
I20260812 02:42:21.536760 10727 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
I20260812 02:42:21.573850 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35959
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:21.709062 10745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:21.709311 10745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:21.709373 10745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:21.713413 10745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:21.713465 10745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:21.713574 10745 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:42:21.718686 10745 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35959
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:21.719676 10745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:21.720739 10745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:21.730369 10759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:21.730369 10758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:21.730412 10761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:21.730607 10745 server_base.cc:1034] running on GCE node
I20260812 02:42:21.731098 10745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:21.731715 10745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:21.732918 10745 hybrid_clock.cc:648] HybridClock initialized: now 1786502541732879 us; error 59 us; skew 500 ppm
Aug 12 02:42:21 dist-test-slave-2p8l krb5kdc[10551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502541, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:21.735674 10745 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:42:21.736506 10745 webserver.cc:460] Webserver started at http://127.10.75.65:37011/ using document root <none> and password file <none>
I20260812 02:42:21.737057 10745 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:21.737150 10745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:21.737378 10745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:21.739471 10745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "99afff169f604968b4440d6cb9af6902"
format_stamp: "Formatted at 2026-08-12 02:42:21 on dist-test-slave-2p8l"
server_key: "fa3630c94f20ef1a3f0a77618029d9e8"
server_key_iv: "654e2af6b5d44570a80dfe9630763a35"
server_key_version: "encryptionkey@0"
I20260812 02:42:21.740038 10745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "99afff169f604968b4440d6cb9af6902"
format_stamp: "Formatted at 2026-08-12 02:42:21 on dist-test-slave-2p8l"
server_key: "fa3630c94f20ef1a3f0a77618029d9e8"
server_key_iv: "654e2af6b5d44570a80dfe9630763a35"
server_key_version: "encryptionkey@0"
I20260812 02:42:21.743784 10745 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260812 02:42:21.746156 10771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:21.747272 10745 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 02:42:21.747402 10745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "99afff169f604968b4440d6cb9af6902"
format_stamp: "Formatted at 2026-08-12 02:42:21 on dist-test-slave-2p8l"
server_key: "fa3630c94f20ef1a3f0a77618029d9e8"
server_key_iv: "654e2af6b5d44570a80dfe9630763a35"
server_key_version: "encryptionkey@0"
I20260812 02:42:21.747509 10745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:21.763485 10745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:21.766566 10745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:21.766775 10745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:21.767364 10745 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:21.768293 10745 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:21.768368 10745 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:21.768435 10745 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:21.768486 10745 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:21.779277 10745 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:39481
I20260812 02:42:21.779330 10995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:39481 every 8 connection(s)
I20260812 02:42:21.780138 10745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:42:21.782970 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 10745
I20260812 02:42:21.783082 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:42:21.783384 10541 external_mini_cluster.cc:1428] Setting key d01c1ae3650ac53015205d4baa03f3c2
Aug 12 02:42:21 dist-test-slave-2p8l krb5kdc[10551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502541, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.75.66@KRBTEST.COM; defaulting to no policy
I20260812 02:42:21.796098 10709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:21.781995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:56679 (local address 127.10.75.126:35959)
0812 02:42:21.782181 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:21.782186 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:21.783172 (+ 986us) server_negotiation.cc:407] Connection header received
0812 02:42:21.784858 (+ 1686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:21.784861 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:21.784912 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:21.785006 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:21.786774 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:21.787300 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:21.788760 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:21.789212 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:21.789348 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:21.791867 (+ 2519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:21.791873 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:21.791877 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:21.791910 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:21.793735 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:21.794355 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:21.794358 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:21.794360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:21.794457 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:21.794853 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:21.794858 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:21.794861 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:21.795124 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:21.795245 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:21.795817 (+ 572us) server_negotiation.cc:299] Negotiation successful
0812 02:42:21.795968 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 02:42:21.796937 11000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:21.782441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35959 (local address 127.10.75.65:56679)
0812 02:42:21.782993 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:21.783054 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:21.784593 (+ 1539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:21.785211 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:21.785220 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:21.785807 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:21.786614 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:21.786637 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:21.787512 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:21.787519 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:21.788621 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:21.788632 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:21.789368 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:21.789371 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:21.789510 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:21.790174 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:21.790191 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:21.791679 (+ 1488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:21.793866 (+ 2187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:21.793871 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:21.793882 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:21.794232 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:21.794581 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:21.794584 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:21.794585 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:21.794726 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:21.795264 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:21.795269 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:21.795508 (+ 239us) client_negotiation.cc:769] Sending connection context
0812 02:42:21.795728 (+ 220us) client_negotiation.cc:240] Negotiation successful
0812 02:42:21.795986 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":122,"threads_started":1}
I20260812 02:42:21.798328 10996 heartbeater.cc:347] Connected to a master server at 127.10.75.126:35959
I20260812 02:42:21.798619 10996 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.66@KRBTEST.COM" created.
I20260812 02:42:21.799201 10996 heartbeater.cc:511] Master 127.10.75.126:35959 requested a full tablet report, sending...
I20260812 02:42:21.800866 10632 ts_manager.cc:194] Registered new tserver with Master: 99afff169f604968b4440d6cb9af6902 (127.10.75.65:39481)
I20260812 02:42:21.802531 10632 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:56679
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
I20260812 02:42:21.817154 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35959
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:21.931066 11005 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:21.931301 11005 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:21.931375 11005 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:21.935338 11005 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:21.935395 11005 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:21.935497 11005 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:42:21.940755 11005 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35959
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11005
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:21.941805 11005 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:21.942906 11005 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:21.952782 11014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:21.952782 11012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:21.952847 11011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:21.953110 11005 server_base.cc:1034] running on GCE node
I20260812 02:42:21.953538 11005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:21.954144 11005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:21.955320 11005 hybrid_clock.cc:648] HybridClock initialized: now 1786502541955291 us; error 41 us; skew 500 ppm
Aug 12 02:42:21 dist-test-slave-2p8l krb5kdc[10551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502541, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:21.957983 11005 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:42:21.958913 11005 webserver.cc:460] Webserver started at http://127.10.75.66:38555/ using document root <none> and password file <none>
I20260812 02:42:21.959466 11005 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:21.959527 11005 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:21.959777 11005 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:21.961782 11005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "9cae5390472b4f73b5b90e7336fc2fff"
format_stamp: "Formatted at 2026-08-12 02:42:21 on dist-test-slave-2p8l"
server_key: "7203c295567e7dc5dbbaf2b2204ec177"
server_key_iv: "807711ef10fe1aae388e85c0b4b068ee"
server_key_version: "encryptionkey@0"
I20260812 02:42:21.962376 11005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "9cae5390472b4f73b5b90e7336fc2fff"
format_stamp: "Formatted at 2026-08-12 02:42:21 on dist-test-slave-2p8l"
server_key: "7203c295567e7dc5dbbaf2b2204ec177"
server_key_iv: "807711ef10fe1aae388e85c0b4b068ee"
server_key_version: "encryptionkey@0"
I20260812 02:42:21.966426 11005 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 02:42:21.968956 11025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:21.970221 11005 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:21.970351 11005 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "9cae5390472b4f73b5b90e7336fc2fff"
format_stamp: "Formatted at 2026-08-12 02:42:21 on dist-test-slave-2p8l"
server_key: "7203c295567e7dc5dbbaf2b2204ec177"
server_key_iv: "807711ef10fe1aae388e85c0b4b068ee"
server_key_version: "encryptionkey@0"
I20260812 02:42:21.970476 11005 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:21.992045 11005 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:21.995286 11005 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:21.995510 11005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:21.996198 11005 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:21.997040 11005 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:21.997113 11005 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:21.997190 11005 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:21.997236 11005 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:22.007215 11005 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:38981
I20260812 02:42:22.007241 11214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:38981 every 8 connection(s)
I20260812 02:42:22.008183 11005 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:42:22.014312 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 11005
I20260812 02:42:22.014431 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:42:22.014751 10541 external_mini_cluster.cc:1428] Setting key 5829e8bf7c5457eff190d8980a64eb5d
Aug 12 02:42:22 dist-test-slave-2p8l krb5kdc[10551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502541, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:22.023061 10709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:22.010130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:56747 (local address 127.10.75.126:35959)
0812 02:42:22.010278 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:22.010283 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:22.011157 (+ 874us) server_negotiation.cc:407] Connection header received
0812 02:42:22.012357 (+ 1200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:22.012360 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:22.012407 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:22.012482 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:22.013606 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:22.014213 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:22.015644 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:22.015961 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:22.016093 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:22.019106 (+ 3013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:22.019109 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:22.019111 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:22.019136 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:22.020828 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:22.021339 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:22.021346 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:22.021350 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:22.021444 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:22.021781 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:22.021787 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:22.021792 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:22.022050 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:22.022179 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:22.022674 (+ 495us) server_negotiation.cc:299] Negotiation successful
0812 02:42:22.022815 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 02:42:22.023679 11217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:22.010569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35959 (local address 127.10.75.66:56747)
0812 02:42:22.011004 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:22.011046 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:22.012162 (+ 1116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:22.012668 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:22.012675 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:22.013023 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:22.013476 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:22.013488 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:22.014351 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:22.014356 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:22.015511 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:22.015522 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:22.016157 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:22.016160 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:22.016358 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:22.016942 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:22.016967 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:22.018927 (+ 1960us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:22.020952 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:22.020958 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:22.020969 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:22.021232 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:22.021543 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:22.021545 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:22.021546 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:22.021676 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:22.022194 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:22.022199 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:22.022421 (+ 222us) client_negotiation.cc:769] Sending connection context
0812 02:42:22.022576 (+ 155us) client_negotiation.cc:240] Negotiation successful
0812 02:42:22.022824 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":106,"threads_started":1}
I20260812 02:42:22.024889 11215 heartbeater.cc:347] Connected to a master server at 127.10.75.126:35959
I20260812 02:42:22.025146 11215 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:22.025626 11215 heartbeater.cc:511] Master 127.10.75.126:35959 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.75.67@KRBTEST.COM; defaulting to no policy
I20260812 02:42:22.026739 10632 ts_manager.cc:194] Registered new tserver with Master: 9cae5390472b4f73b5b90e7336fc2fff (127.10.75.66:38981)
I20260812 02:42:22.027338 10632 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:56747
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
I20260812 02:42:22.045619 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35959
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:22.156550 11220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:22.156785 11220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:22.156828 11220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:22.160792 11220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:22.160847 11220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:22.160904 11220 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:42:22.165925 11220 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35959
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:22.166960 11220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:22.167976 11220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:22.177758 11227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:22.177737 11226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:22.177762 11234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:22.177961 11220 server_base.cc:1034] running on GCE node
I20260812 02:42:22.178470 11220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:22.179118 11220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:22.180285 11220 hybrid_clock.cc:648] HybridClock initialized: now 1786502542180251 us; error 43 us; skew 500 ppm
Aug 12 02:42:22 dist-test-slave-2p8l krb5kdc[10551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502542, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:22.183171 11220 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:42:22.184108 11220 webserver.cc:460] Webserver started at http://127.10.75.67:43143/ using document root <none> and password file <none>
I20260812 02:42:22.184767 11220 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:22.184862 11220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:22.185104 11220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:22.187326 11220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "055acb5aab2a4b34a8edc757266f3dc9"
format_stamp: "Formatted at 2026-08-12 02:42:22 on dist-test-slave-2p8l"
server_key: "d8b920f6adb84a2e3516738a3c4036ed"
server_key_iv: "080a86541540fef81b2ec6c64a03248a"
server_key_version: "encryptionkey@0"
I20260812 02:42:22.187902 11220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "055acb5aab2a4b34a8edc757266f3dc9"
format_stamp: "Formatted at 2026-08-12 02:42:22 on dist-test-slave-2p8l"
server_key: "d8b920f6adb84a2e3516738a3c4036ed"
server_key_iv: "080a86541540fef81b2ec6c64a03248a"
server_key_version: "encryptionkey@0"
I20260812 02:42:22.191740 11220 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 02:42:22.194176 11248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:22.195374 11220 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:22.195542 11220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "055acb5aab2a4b34a8edc757266f3dc9"
format_stamp: "Formatted at 2026-08-12 02:42:22 on dist-test-slave-2p8l"
server_key: "d8b920f6adb84a2e3516738a3c4036ed"
server_key_iv: "080a86541540fef81b2ec6c64a03248a"
server_key_version: "encryptionkey@0"
I20260812 02:42:22.195683 11220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:22.211499 11220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:22.214527 11220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:22.214768 11220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:22.215344 11220 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:22.216151 11220 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:22.216228 11220 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:22.216296 11220 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:22.216347 11220 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:22.225587 11220 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:38833
I20260812 02:42:22.225601 11459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:38833 every 8 connection(s)
I20260812 02:42:22.226544 11220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:42:22.232321 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 11220
I20260812 02:42:22.232440 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:42:22.232728 10541 external_mini_cluster.cc:1428] Setting key f2930adc879260041f3c59a0166a1cc7
Aug 12 02:42:22 dist-test-slave-2p8l krb5kdc[10551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502542, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:22.239945 10709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:22.228330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:46933 (local address 127.10.75.126:35959)
0812 02:42:22.228475 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:22.228479 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:22.229297 (+ 818us) server_negotiation.cc:407] Connection header received
0812 02:42:22.230561 (+ 1264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:22.230564 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:22.230637 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:22.230713 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:22.231788 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:22.232494 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:22.233856 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:22.234207 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:22.234353 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:22.236927 (+ 2574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:22.236930 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:22.236932 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:22.236956 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:22.238279 (+ 1323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:22.238727 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:22.238729 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:22.238731 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:22.238803 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:22.239085 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:22.239087 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:22.239088 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:22.239249 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:22.239323 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:22.239738 (+ 415us) server_negotiation.cc:299] Negotiation successful
0812 02:42:22.239829 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 02:42:22.240720 11464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:22.228701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35959 (local address 127.10.75.67:46933)
0812 02:42:22.229147 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:22.229188 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:22.230356 (+ 1168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:22.230868 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:22.230874 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:22.231208 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:22.231652 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:22.231666 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:22.232647 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:22.232650 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:22.233694 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:22.233724 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:22.234402 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:22.234407 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:22.234624 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:22.235293 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:22.235312 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:22.236776 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:22.238379 (+ 1603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:22.238383 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:22.238393 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:22.238640 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:22.238882 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:22.238884 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:22.238885 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:22.239005 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:22.239334 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:22.239338 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:22.239541 (+ 203us) client_negotiation.cc:769] Sending connection context
0812 02:42:22.239694 (+ 153us) client_negotiation.cc:240] Negotiation successful
0812 02:42:22.239916 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":117,"threads_started":1}
I20260812 02:42:22.241859 11460 heartbeater.cc:347] Connected to a master server at 127.10.75.126:35959
I20260812 02:42:22.242154 11460 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:22.242617 11460 heartbeater.cc:511] Master 127.10.75.126:35959 requested a full tablet report, sending...
I20260812 02:42:22.243609 10632 ts_manager.cc:194] Registered new tserver with Master: 055acb5aab2a4b34a8edc757266f3dc9 (127.10.75.67:38833)
I20260812 02:42:22.244172 10632 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:46933
I20260812 02:42:22.247282 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 02:42:22 dist-test-slave-2p8l krb5kdc[10551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502542, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 02:42:22 dist-test-slave-2p8l krb5kdc[10551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502542, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.75.65@KRBTEST.COM
I20260812 02:42:22.275074 11472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:22.265447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53558 (local address 127.10.75.65:39481)
0812 02:42:22.265845 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:22.265861 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:22.265885 (+ 24us) server_negotiation.cc:407] Connection header received
0812 02:42:22.266051 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:22.266057 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:22.266304 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:22.266427 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:22.267092 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:22.267879 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:22.268749 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:22.269102 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:22.269184 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:22.271541 (+ 2357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:22.271550 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:22.271563 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:22.271586 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:22.273301 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:22.273661 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:22.273666 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:22.273668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:22.273766 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:22.274002 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:22.274004 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:22.274005 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:22.274284 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:22.274472 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:22.274691 (+ 219us) server_negotiation.cc:299] Negotiation successful
0812 02:42:22.274866 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":209,"threads_started":1}
W20260812 02:42:22.276103 10824 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53558
Aug 12 02:42:22 dist-test-slave-2p8l krb5kdc[10551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 02:42:22 dist-test-slave-2p8l krb5kdc[10551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.65@KRBTEST.COM
I20260812 02:42:22.302860 11472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:22.294836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53564 (local address 127.10.75.65:39481)
0812 02:42:22.294990 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:22.294995 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:22.295143 (+ 148us) server_negotiation.cc:407] Connection header received
0812 02:42:22.295242 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:22.295244 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:22.295283 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:22.295348 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:22.295962 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:22.296451 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:22.297213 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:22.297452 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:22.297527 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:22.299869 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:22.299873 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:22.299876 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:22.299903 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:22.301206 (+ 1303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:22.301610 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:22.301616 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:22.301620 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:22.301701 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:22.301979 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:22.301982 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:22.301984 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:22.302197 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:22.302342 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:22.302581 (+ 239us) server_negotiation.cc:299] Negotiation successful
0812 02:42:22.302698 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 02:42:22.303957 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 10745
I20260812 02:42:22.320154 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 11005
I20260812 02:42:22.344058 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 11220
I20260812 02:42:22.355338 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 10575
2026-08-12T02:42:22Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2642 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:42:22 dist-test-slave-2p8l krb5kdc[11484](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:42:22 dist-test-slave-2p8l krb5kdc[11484](info): set up 2 sockets
Aug 12 02:42:22 dist-test-slave-2p8l krb5kdc[11484](info): commencing operation
krb5kdc: starting...
W20260812 02:42:23.667275 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:42:23 dist-test-slave-2p8l krb5kdc[11484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:42:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:42:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:42:23.796793 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:46511
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:46511
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:23.910480 11508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:23.910806 11508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:23.910900 11508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:23.914862 11508 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:42:23.914940 11508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:23.914983 11508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:23.915040 11508 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:42:23.915068 11508 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:42:23.920135 11508 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:46511
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:46511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:23.921146 11508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:23.922191 11508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:23.930629 11523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:23.930629 11527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:23.930622 11522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:23.931020 11508 server_base.cc:1034] running on GCE node
I20260812 02:42:23.931610 11508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:23.932688 11508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:23.933866 11508 hybrid_clock.cc:648] HybridClock initialized: now 1786502543933846 us; error 30 us; skew 500 ppm
Aug 12 02:42:23 dist-test-slave-2p8l krb5kdc[11484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502543, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:23.942298 11508 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:42:23.943315 11508 webserver.cc:460] Webserver started at http://127.10.75.126:41857/ using document root <none> and password file <none>
I20260812 02:42:23.943915 11508 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:23.944000 11508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:23.944255 11508 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:23.946563 11508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "a252a60d4d3a4c0db47d2b4f75192ef4"
format_stamp: "Formatted at 2026-08-12 02:42:23 on dist-test-slave-2p8l"
server_key: "4d60cbd6ef60bb331c4599823b6d4df4"
server_key_iv: "58015f2ba4cc29271e5ef7434483cce7"
server_key_version: "encryptionkey@0"
I20260812 02:42:23.947198 11508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "a252a60d4d3a4c0db47d2b4f75192ef4"
format_stamp: "Formatted at 2026-08-12 02:42:23 on dist-test-slave-2p8l"
server_key: "4d60cbd6ef60bb331c4599823b6d4df4"
server_key_iv: "58015f2ba4cc29271e5ef7434483cce7"
server_key_version: "encryptionkey@0"
I20260812 02:42:23.951304 11508 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260812 02:42:23.953846 11537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:23.955170 11508 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 02:42:23.955334 11508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "a252a60d4d3a4c0db47d2b4f75192ef4"
format_stamp: "Formatted at 2026-08-12 02:42:23 on dist-test-slave-2p8l"
server_key: "4d60cbd6ef60bb331c4599823b6d4df4"
server_key_iv: "58015f2ba4cc29271e5ef7434483cce7"
server_key_version: "encryptionkey@0"
I20260812 02:42:23.955461 11508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:23.977743 11508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:23.981526 11508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:23.981819 11508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:23.990072 11508 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:46511
I20260812 02:42:23.990118 11634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:46511 every 8 connection(s)
I20260812 02:42:23.991132 11508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:42:23.992822 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 11508
I20260812 02:42:23.992933 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:42:23.993225 10541 external_mini_cluster.cc:1428] Setting key 674ae1fcc54a9119366fb3a8114767de
I20260812 02:42:23.994179 11638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:24.001008 11638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4: Bootstrap starting.
Aug 12 02:42:23 dist-test-slave-2p8l krb5kdc[11484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:24.003713 11638 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:24.004590 11638 log.cc:824] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:24.006983 11638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4: No bootstrap required, opened a new log
I20260812 02:42:24.009090 11642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:23.994756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41746 (local address 127.10.75.126:46511)
0812 02:42:23.995210 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:23.995230 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:23.995275 (+ 45us) server_negotiation.cc:407] Connection header received
0812 02:42:23.996174 (+ 899us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:23.996198 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:23.996613 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:23.996980 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:23.997735 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:23.999253 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.000169 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.000851 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.001024 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.004000 (+ 2976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:24.004006 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:24.004020 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:24.004050 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:24.006034 (+ 1984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:24.006614 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:24.006619 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:24.006643 (+ 24us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:24.006762 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:24.007098 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:24.007102 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:24.007104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:24.007511 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:24.007707 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:24.007993 (+ 286us) server_negotiation.cc:299] Negotiation successful
0812 02:42:24.008333 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":133,"threads_started":1}
I20260812 02:42:24.010960 11638 raft_consensus.cc:348] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a252a60d4d3a4c0db47d2b4f75192ef4" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 46511 } }
I20260812 02:42:24.011174 11638 raft_consensus.cc:374] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:24.011327 11638 raft_consensus.cc:729] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a252a60d4d3a4c0db47d2b4f75192ef4, State: Initialized, Role: FOLLOWER
I20260812 02:42:24.011770 11638 consensus_queue.cc:260] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a252a60d4d3a4c0db47d2b4f75192ef4" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 46511 } }
I20260812 02:42:24.011893 11638 raft_consensus.cc:388] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:42:24.011932 11638 raft_consensus.cc:482] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:42:24.012001 11638 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:24.012920 11638 raft_consensus.cc:504] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a252a60d4d3a4c0db47d2b4f75192ef4" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 46511 } }
I20260812 02:42:24.013211 11638 leader_election.cc:302] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a252a60d4d3a4c0db47d2b4f75192ef4; no voters:
I20260812 02:42:24.013454 11638 leader_election.cc:288] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:42:24.013600 11646 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:24.013872 11646 raft_consensus.cc:686] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4 [term 1 LEADER]: Becoming Leader. State: Replica: a252a60d4d3a4c0db47d2b4f75192ef4, State: Running, Role: LEADER
I20260812 02:42:24.014305 11646 consensus_queue.cc:237] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a252a60d4d3a4c0db47d2b4f75192ef4" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 46511 } }
I20260812 02:42:24.014797 11638 sys_catalog.cc:564] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:42:24.016206 11647 sys_catalog.cc:455] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a252a60d4d3a4c0db47d2b4f75192ef4. Latest consensus state: current_term: 1 leader_uuid: "a252a60d4d3a4c0db47d2b4f75192ef4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a252a60d4d3a4c0db47d2b4f75192ef4" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 46511 } } }
I20260812 02:42:24.016206 11648 sys_catalog.cc:455] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a252a60d4d3a4c0db47d2b4f75192ef4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a252a60d4d3a4c0db47d2b4f75192ef4" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 46511 } } }
I20260812 02:42:24.016403 11647 sys_catalog.cc:458] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:24.016503 11648 sys_catalog.cc:458] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:24.017602 11672 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:42:24.020944 11672 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:42:24.026784 11672 catalog_manager.cc:1347] Generated new cluster ID: 065d40b2296a4109835f5a3289debb0d
I20260812 02:42:24.026867 11672 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:42:24.034538 11672 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:42:24.035655 11672 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:42:24.039216 11672 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a252a60d4d3a4c0db47d2b4f75192ef4: Generated new TSK 0
I20260812 02:42:24.039813 11672 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
I20260812 02:42:24.077958 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:46511
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:24.201526 11685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:24.201788 11685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:24.201833 11685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:24.205922 11685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:24.205981 11685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:24.206099 11685 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:42:24.211284 11685 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:46511
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11685
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:24.212316 11685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:24.213349 11685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:24.223172 11693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:24.223188 11702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:24.223220 11692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:24.223243 11685 server_base.cc:1034] running on GCE node
I20260812 02:42:24.223830 11685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:24.224445 11685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:24.225660 11685 hybrid_clock.cc:648] HybridClock initialized: now 1786502544225626 us; error 47 us; skew 500 ppm
Aug 12 02:42:24 dist-test-slave-2p8l krb5kdc[11484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502544, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:24.228377 11685 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:42:24.229260 11685 webserver.cc:460] Webserver started at http://127.10.75.65:39919/ using document root <none> and password file <none>
I20260812 02:42:24.229823 11685 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:24.229913 11685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:24.230228 11685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:24.232232 11685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "017e4ca67b9149f28330e8edd7b057bd"
format_stamp: "Formatted at 2026-08-12 02:42:24 on dist-test-slave-2p8l"
server_key: "850cfa8d22b361a9c5b9639d25e46d15"
server_key_iv: "f5ae0137884cc4f0bc55cf042a23ec87"
server_key_version: "encryptionkey@0"
I20260812 02:42:24.232816 11685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "017e4ca67b9149f28330e8edd7b057bd"
format_stamp: "Formatted at 2026-08-12 02:42:24 on dist-test-slave-2p8l"
server_key: "850cfa8d22b361a9c5b9639d25e46d15"
server_key_iv: "f5ae0137884cc4f0bc55cf042a23ec87"
server_key_version: "encryptionkey@0"
I20260812 02:42:24.236852 11685 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 02:42:24.239269 11714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:24.240430 11685 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:42:24.240578 11685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "017e4ca67b9149f28330e8edd7b057bd"
format_stamp: "Formatted at 2026-08-12 02:42:24 on dist-test-slave-2p8l"
server_key: "850cfa8d22b361a9c5b9639d25e46d15"
server_key_iv: "f5ae0137884cc4f0bc55cf042a23ec87"
server_key_version: "encryptionkey@0"
I20260812 02:42:24.240687 11685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:24.253664 11685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:24.256659 11685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:24.256870 11685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:24.257475 11685 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:24.258348 11685 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:24.258423 11685 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:24.258491 11685 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:24.258540 11685 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:24.267907 11685 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:37313
I20260812 02:42:24.267930 11922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:37313 every 8 connection(s)
I20260812 02:42:24.268769 11685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:42:24.275815 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 11685
I20260812 02:42:24.275909 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:42:24.276163 10541 external_mini_cluster.cc:1428] Setting key af26d0a708994b83ef9349b70fce473f
Aug 12 02:42:24 dist-test-slave-2p8l krb5kdc[11484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502544, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:24.282793 11642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.270571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:35021 (local address 127.10.75.126:46511)
0812 02:42:24.270739 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:24.270744 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:24.271576 (+ 832us) server_negotiation.cc:407] Connection header received
0812 02:42:24.272389 (+ 813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:24.272392 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:24.272440 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:24.272516 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:24.273622 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.274179 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.275277 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.275537 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.275653 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.278423 (+ 2770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:24.278430 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:24.278435 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:24.278469 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:24.280420 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:24.281079 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:24.281082 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:24.281083 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:24.281163 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:24.281608 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:24.281611 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:24.281613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:24.281792 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:24.281879 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:24.282472 (+ 593us) server_negotiation.cc:299] Negotiation successful
0812 02:42:24.282609 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 02:42:24.283622 11928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.270966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:46511 (local address 127.10.75.65:35021)
0812 02:42:24.271421 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:24.271463 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:24.272193 (+ 730us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:24.272684 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:24.272691 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:24.273023 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:24.273480 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:24.273492 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.274295 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.274297 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:24.275153 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:24.275162 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.275699 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.275702 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:24.275855 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.276586 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:24.276602 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:24.278258 (+ 1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:24.280557 (+ 2299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:24.280566 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:24.280582 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:24.280959 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:24.281267 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:24.281272 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:24.281277 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:24.281483 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:24.281901 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:24.281906 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:24.282228 (+ 322us) client_negotiation.cc:769] Sending connection context
0812 02:42:24.282427 (+ 199us) client_negotiation.cc:240] Negotiation successful
0812 02:42:24.282738 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":118,"threads_started":1}
I20260812 02:42:24.285112 11925 heartbeater.cc:347] Connected to a master server at 127.10.75.126:46511
I20260812 02:42:24.285383 11925 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:24.285877 11925 heartbeater.cc:511] Master 127.10.75.126:46511 requested a full tablet report, sending...
I20260812 02:42:24.287737 11575 ts_manager.cc:194] Registered new tserver with Master: 017e4ca67b9149f28330e8edd7b057bd (127.10.75.65:37313)
WARNING: no policy specified for kudu/127.10.75.66@KRBTEST.COM; defaulting to no policy
I20260812 02:42:24.289096 11575 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:35021
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
I20260812 02:42:24.306799 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:46511
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:24.418143 11933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:24.418396 11933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:24.418437 11933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:24.422415 11933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:24.422462 11933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:24.422516 11933 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:42:24.427500 11933 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:46511
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11933
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:24.428411 11933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:24.429342 11933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:24.438879 11940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:24.438880 11939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:24.438899 11943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:24.439086 11933 server_base.cc:1034] running on GCE node
I20260812 02:42:24.439512 11933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:24.440110 11933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:24.441273 11933 hybrid_clock.cc:648] HybridClock initialized: now 1786502544441261 us; error 24 us; skew 500 ppm
Aug 12 02:42:24 dist-test-slave-2p8l krb5kdc[11484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502544, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:24.443988 11933 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:42:24.444911 11933 webserver.cc:460] Webserver started at http://127.10.75.66:40861/ using document root <none> and password file <none>
I20260812 02:42:24.445441 11933 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:24.445534 11933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:24.445771 11933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:24.447827 11933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "eeaea2c1d66b47e787830c3c739e5318"
format_stamp: "Formatted at 2026-08-12 02:42:24 on dist-test-slave-2p8l"
server_key: "3663ccf05752be84558b2b85b91bb665"
server_key_iv: "b62c016c69a51e9976dbe862e888c412"
server_key_version: "encryptionkey@0"
I20260812 02:42:24.448385 11933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "eeaea2c1d66b47e787830c3c739e5318"
format_stamp: "Formatted at 2026-08-12 02:42:24 on dist-test-slave-2p8l"
server_key: "3663ccf05752be84558b2b85b91bb665"
server_key_iv: "b62c016c69a51e9976dbe862e888c412"
server_key_version: "encryptionkey@0"
I20260812 02:42:24.452045 11933 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 02:42:24.454429 11950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:24.455657 11933 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:24.455775 11933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "eeaea2c1d66b47e787830c3c739e5318"
format_stamp: "Formatted at 2026-08-12 02:42:24 on dist-test-slave-2p8l"
server_key: "3663ccf05752be84558b2b85b91bb665"
server_key_iv: "b62c016c69a51e9976dbe862e888c412"
server_key_version: "encryptionkey@0"
I20260812 02:42:24.455875 11933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:24.477368 11933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:24.480264 11933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:24.480472 11933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:24.481096 11933 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:24.481936 11933 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:24.481984 11933 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:24.482054 11933 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:24.482126 11933 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:24.491812 11933 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:36435
I20260812 02:42:24.491844 12163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:36435 every 8 connection(s)
I20260812 02:42:24.492667 11933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:42:24.493279 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 11933
I20260812 02:42:24.493413 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:42:24.493719 10541 external_mini_cluster.cc:1428] Setting key 1c49e6da7d7894ae7fa101af93319c4f
Aug 12 02:42:24 dist-test-slave-2p8l krb5kdc[11484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502544, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.75.67@KRBTEST.COM; defaulting to no policy
I20260812 02:42:24.506562 11642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.494575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:48443 (local address 127.10.75.126:46511)
0812 02:42:24.494714 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:24.494720 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:24.495678 (+ 958us) server_negotiation.cc:407] Connection header received
0812 02:42:24.496548 (+ 870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:24.496551 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:24.496604 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:24.496683 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:24.498015 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.498618 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.499858 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.500096 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.500215 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.502860 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:24.502863 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:24.502865 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:24.502889 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:24.504380 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:24.504952 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:24.504956 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:24.504958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:24.505041 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:24.505513 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:24.505516 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:24.505517 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:24.505716 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:24.505800 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:24.506334 (+ 534us) server_negotiation.cc:299] Negotiation successful
0812 02:42:24.506440 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.67@KRBTEST.COM" created.
I20260812 02:42:24.507637 12168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.495018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:46511 (local address 127.10.75.66:48443)
0812 02:42:24.495499 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:24.495542 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:24.496351 (+ 809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:24.496847 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:24.496853 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:24.497186 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:24.497849 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:24.497870 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.498757 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.498763 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:24.499724 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:24.499734 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.500257 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.500262 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:24.500426 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.501034 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:24.501049 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:24.502662 (+ 1613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:24.504544 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:24.504550 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:24.504563 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:24.504842 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:24.505157 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:24.505161 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:24.505163 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:24.505377 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:24.505824 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:24.505829 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:24.506046 (+ 217us) client_negotiation.cc:769] Sending connection context
0812 02:42:24.506282 (+ 236us) client_negotiation.cc:240] Negotiation successful
0812 02:42:24.506699 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":119,"threads_started":1}
I20260812 02:42:24.510018 12165 heartbeater.cc:347] Connected to a master server at 127.10.75.126:46511
I20260812 02:42:24.510299 12165 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:24.510790 12165 heartbeater.cc:511] Master 127.10.75.126:46511 requested a full tablet report, sending...
I20260812 02:42:24.511936 11575 ts_manager.cc:194] Registered new tserver with Master: eeaea2c1d66b47e787830c3c739e5318 (127.10.75.66:36435)
I20260812 02:42:24.512498 11575 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:48443
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
I20260812 02:42:24.524864 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:46511
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:24.639187 12172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:24.639456 12172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:24.639534 12172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:24.643508 12172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:24.643594 12172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:24.643678 12172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:42:24.648948 12172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:46511
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:24.649967 12172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:24.650991 12172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:24.660689 12178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:24.660682 12184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:24.660856 12179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:24.661103 12172 server_base.cc:1034] running on GCE node
I20260812 02:42:24.661438 12172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:24.662045 12172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:24.663264 12172 hybrid_clock.cc:648] HybridClock initialized: now 1786502544663248 us; error 25 us; skew 500 ppm
Aug 12 02:42:24 dist-test-slave-2p8l krb5kdc[11484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502544, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:24.666224 12172 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:42:24.667076 12172 webserver.cc:460] Webserver started at http://127.10.75.67:41135/ using document root <none> and password file <none>
I20260812 02:42:24.667649 12172 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:24.667711 12172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:24.667946 12172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:24.669961 12172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "c6f990dae70c4cada44e01b1f2402ff8"
format_stamp: "Formatted at 2026-08-12 02:42:24 on dist-test-slave-2p8l"
server_key: "8be9d888e3c15166ac92cae763fac2b0"
server_key_iv: "5de3d5d61f551195d94ab5d65a413a7f"
server_key_version: "encryptionkey@0"
I20260812 02:42:24.670595 12172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "c6f990dae70c4cada44e01b1f2402ff8"
format_stamp: "Formatted at 2026-08-12 02:42:24 on dist-test-slave-2p8l"
server_key: "8be9d888e3c15166ac92cae763fac2b0"
server_key_iv: "5de3d5d61f551195d94ab5d65a413a7f"
server_key_version: "encryptionkey@0"
I20260812 02:42:24.674367 12172 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 02:42:24.676651 12195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:24.677825 12172 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:42:24.677964 12172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "c6f990dae70c4cada44e01b1f2402ff8"
format_stamp: "Formatted at 2026-08-12 02:42:24 on dist-test-slave-2p8l"
server_key: "8be9d888e3c15166ac92cae763fac2b0"
server_key_iv: "5de3d5d61f551195d94ab5d65a413a7f"
server_key_version: "encryptionkey@0"
I20260812 02:42:24.678092 12172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:24.694607 12172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:24.697418 12172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:24.697621 12172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:24.698253 12172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:24.699059 12172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:24.699139 12172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:24.699231 12172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:24.699283 12172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:24.708462 12172 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:42297
I20260812 02:42:24.708493 12421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:42297 every 8 connection(s)
I20260812 02:42:24.709316 12172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:42:24.711301 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 12172
I20260812 02:42:24.711465 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:42:24.711989 10541 external_mini_cluster.cc:1428] Setting key a1c3f2a2c9eb7b4c86b8e0cd49d0e89a
Aug 12 02:42:24 dist-test-slave-2p8l krb5kdc[11484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502544, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:24.722719 11642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.711106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:60081 (local address 127.10.75.126:46511)
0812 02:42:24.711307 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:24.711313 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:24.712547 (+ 1234us) server_negotiation.cc:407] Connection header received
0812 02:42:24.713825 (+ 1278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:24.713828 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:24.713894 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:24.713982 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:24.715267 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.715872 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.716997 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.717225 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.717334 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.719734 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:24.719737 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:24.719739 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:24.719763 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:24.720968 (+ 1205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:24.721425 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:24.721427 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:24.721429 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:24.721500 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:24.721794 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:24.721796 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:24.721797 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:24.721957 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:24.722033 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:24.722502 (+ 469us) server_negotiation.cc:299] Negotiation successful
0812 02:42:24.722597 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 02:42:24.723465 12428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.711580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:46511 (local address 127.10.75.67:60081)
0812 02:42:24.712282 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:24.712377 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:24.713588 (+ 1211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:24.714177 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:24.714184 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:24.714553 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:24.715119 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:24.715133 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.715999 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.716004 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:24.716862 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:24.716871 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.717382 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.717387 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:24.717556 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.718154 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:24.718171 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:24.719565 (+ 1394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:24.721070 (+ 1505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:24.721081 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:24.721092 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:24.721336 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:24.721578 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:24.721581 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:24.721582 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:24.721712 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:24.722046 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:24.722050 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:24.722298 (+ 248us) client_negotiation.cc:769] Sending connection context
0812 02:42:24.722452 (+ 154us) client_negotiation.cc:240] Negotiation successful
0812 02:42:24.722684 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":191,"threads_started":1}
I20260812 02:42:24.724538 12422 heartbeater.cc:347] Connected to a master server at 127.10.75.126:46511
I20260812 02:42:24.724730 12422 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:24.725214 12422 heartbeater.cc:511] Master 127.10.75.126:46511 requested a full tablet report, sending...
I20260812 02:42:24.726285 11575 ts_manager.cc:194] Registered new tserver with Master: c6f990dae70c4cada44e01b1f2402ff8 (127.10.75.67:42297)
I20260812 02:42:24.726765 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:42:24.726995 11575 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:60081
I20260812 02:42:24.737430 11642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.730359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41760 (local address 127.10.75.126:46511)
0812 02:42:24.730466 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:24.730473 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:24.730693 (+ 220us) server_negotiation.cc:407] Connection header received
0812 02:42:24.730827 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:24.730830 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:24.730875 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:24.730957 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:24.731656 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.732133 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.732953 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.733169 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.733279 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.734586 (+ 1307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:24.734590 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:24.734593 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:24.734627 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:24.735784 (+ 1157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:24.736206 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:24.736211 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:24.736213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:24.736291 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:24.736569 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:24.736572 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:24.736574 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:24.736778 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:24.736923 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:24.737165 (+ 242us) server_negotiation.cc:299] Negotiation successful
0812 02:42:24.737272 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 02:42:24.741588 11575 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41760:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:42:24.744577 11575 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:42:24.758927 12450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.753648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55276 (local address 127.10.75.66:36435)
0812 02:42:24.754392 (+ 744us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:24.754405 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:24.754428 (+ 23us) server_negotiation.cc:407] Connection header received
0812 02:42:24.754513 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:24.754518 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:24.754713 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:24.755080 (+ 367us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:24.755274 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.756050 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.757545 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.758172 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.758296 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.758444 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:24.758689 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 02:42:24.758784 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":107,"threads_started":1}
I20260812 02:42:24.758919 12454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.753175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:36435 (local address 127.0.0.1:55276)
0812 02:42:24.754039 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:24.754052 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:24.754159 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:24.754877 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:24.754880 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:24.754910 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:24.755139 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:24.755150 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.756194 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.756200 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:24.757424 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:24.757434 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.758297 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.758300 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:24.758406 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.758442 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 02:42:24.758606 (+ 164us) client_negotiation.cc:240] Negotiation successful
0812 02:42:24.758734 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":794,"mutex_wait_us":98,"spinlock_wait_cycles":1920,"thread_start_us":95,"threads_started":1}
I20260812 02:42:24.759617 12446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.752973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:37313 (local address 127.0.0.1:56534)
0812 02:42:24.753307 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:24.753349 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:24.753469 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:24.755030 (+ 1561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:24.755033 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:24.755048 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:24.755244 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:24.755252 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.756665 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.756669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:24.758149 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:24.758161 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.759156 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.759160 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:24.759302 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.759333 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 02:42:24.759414 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 02:42:24.759483 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":236,"thread_start_us":101,"threads_started":1}
I20260812 02:42:24.759706 12447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.753123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56534 (local address 127.10.75.65:37313)
0812 02:42:24.754450 (+ 1327us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:24.754464 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:24.754483 (+ 19us) server_negotiation.cc:407] Connection header received
0812 02:42:24.754546 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:24.754550 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:24.754712 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:24.754869 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:24.755381 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.756500 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.758308 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.759012 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.759159 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.759308 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:24.759468 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 02:42:24.759552 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1232,"thread_start_us":136,"threads_started":1}
I20260812 02:42:24.761889 12040 tablet_service.cc:1467] Processing CreateTablet for tablet 96ba2ec489e144c59bce27967af3d2e6 (DEFAULT_TABLE table=test-table [id=05f8142b4a6e4ed185fe09c8a6deaef4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:24.761984 11804 tablet_service.cc:1467] Processing CreateTablet for tablet 96ba2ec489e144c59bce27967af3d2e6 (DEFAULT_TABLE table=test-table [id=05f8142b4a6e4ed185fe09c8a6deaef4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:24.763005 12040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ba2ec489e144c59bce27967af3d2e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:24.763047 11804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ba2ec489e144c59bce27967af3d2e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:24.763756 12457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.753881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59448 (local address 127.10.75.67:42297)
0812 02:42:24.754402 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:24.754416 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:24.754438 (+ 22us) server_negotiation.cc:407] Connection header received
0812 02:42:24.754512 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:24.754519 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:24.754696 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:24.754868 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:24.755286 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.756489 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.762264 (+ 5775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.763084 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.763240 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.763372 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:24.763513 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 02:42:24.763600 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":180,"threads_started":1}
I20260812 02:42:24.764056 12448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.753686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:42297 (local address 127.0.0.1:59448)
0812 02:42:24.754111 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:24.754127 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:24.754229 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:24.754864 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:24.754869 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:24.754891 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:24.755150 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:24.755156 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.756665 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.756669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:24.758150 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:24.758161 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.763267 (+ 5106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.763271 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:24.763359 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.763381 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 02:42:24.763470 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 02:42:24.763538 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":184,"spinlock_wait_cycles":1408,"thread_start_us":100,"threads_started":1}
I20260812 02:42:24.768951 12463 tablet_bootstrap.cc:492] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd: Bootstrap starting.
I20260812 02:42:24.769418 12459 tablet_bootstrap.cc:492] T 96ba2ec489e144c59bce27967af3d2e6 P eeaea2c1d66b47e787830c3c739e5318: Bootstrap starting.
I20260812 02:42:24.771306 12463 tablet_bootstrap.cc:654] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:24.771937 12459 tablet_bootstrap.cc:654] T 96ba2ec489e144c59bce27967af3d2e6 P eeaea2c1d66b47e787830c3c739e5318: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:24.772408 12463 log.cc:824] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:24.772733 12459 log.cc:824] T 96ba2ec489e144c59bce27967af3d2e6 P eeaea2c1d66b47e787830c3c739e5318: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:24.772782 12294 tablet_service.cc:1467] Processing CreateTablet for tablet 96ba2ec489e144c59bce27967af3d2e6 (DEFAULT_TABLE table=test-table [id=05f8142b4a6e4ed185fe09c8a6deaef4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:24.773833 12294 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ba2ec489e144c59bce27967af3d2e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:24.774539 12459 tablet_bootstrap.cc:492] T 96ba2ec489e144c59bce27967af3d2e6 P eeaea2c1d66b47e787830c3c739e5318: No bootstrap required, opened a new log
I20260812 02:42:24.774570 12463 tablet_bootstrap.cc:492] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd: No bootstrap required, opened a new log
I20260812 02:42:24.774747 12459 ts_tablet_manager.cc:1397] T 96ba2ec489e144c59bce27967af3d2e6 P eeaea2c1d66b47e787830c3c739e5318: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 02:42:24.774755 12463 ts_tablet_manager.cc:1397] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 02:42:24.777707 12459 raft_consensus.cc:348] T 96ba2ec489e144c59bce27967af3d2e6 P eeaea2c1d66b47e787830c3c739e5318 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017e4ca67b9149f28330e8edd7b057bd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37313 } } peers { permanent_uuid: "c6f990dae70c4cada44e01b1f2402ff8" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42297 } } peers { permanent_uuid: "eeaea2c1d66b47e787830c3c739e5318" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36435 } }
I20260812 02:42:24.777947 12459 raft_consensus.cc:374] T 96ba2ec489e144c59bce27967af3d2e6 P eeaea2c1d66b47e787830c3c739e5318 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:24.778002 12459 raft_consensus.cc:729] T 96ba2ec489e144c59bce27967af3d2e6 P eeaea2c1d66b47e787830c3c739e5318 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeaea2c1d66b47e787830c3c739e5318, State: Initialized, Role: FOLLOWER
I20260812 02:42:24.778460 12459 consensus_queue.cc:260] T 96ba2ec489e144c59bce27967af3d2e6 P eeaea2c1d66b47e787830c3c739e5318 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017e4ca67b9149f28330e8edd7b057bd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37313 } } peers { permanent_uuid: "c6f990dae70c4cada44e01b1f2402ff8" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42297 } } peers { permanent_uuid: "eeaea2c1d66b47e787830c3c739e5318" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36435 } }
I20260812 02:42:24.778549 12463 raft_consensus.cc:348] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017e4ca67b9149f28330e8edd7b057bd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37313 } } peers { permanent_uuid: "c6f990dae70c4cada44e01b1f2402ff8" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42297 } } peers { permanent_uuid: "eeaea2c1d66b47e787830c3c739e5318" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36435 } }
I20260812 02:42:24.778832 12463 raft_consensus.cc:374] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:24.778911 12463 raft_consensus.cc:729] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017e4ca67b9149f28330e8edd7b057bd, State: Initialized, Role: FOLLOWER
I20260812 02:42:24.779230 12165 heartbeater.cc:503] Master 127.10.75.126:46511 was elected leader, sending a full tablet report...
I20260812 02:42:24.779356 12463 consensus_queue.cc:260] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017e4ca67b9149f28330e8edd7b057bd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37313 } } peers { permanent_uuid: "c6f990dae70c4cada44e01b1f2402ff8" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42297 } } peers { permanent_uuid: "eeaea2c1d66b47e787830c3c739e5318" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36435 } }
I20260812 02:42:24.779474 12459 ts_tablet_manager.cc:1428] T 96ba2ec489e144c59bce27967af3d2e6 P eeaea2c1d66b47e787830c3c739e5318: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 02:42:24.780269 12463 ts_tablet_manager.cc:1428] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 02:42:24.780596 11925 heartbeater.cc:503] Master 127.10.75.126:46511 was elected leader, sending a full tablet report...
I20260812 02:42:24.780961 12469 tablet_bootstrap.cc:492] T 96ba2ec489e144c59bce27967af3d2e6 P c6f990dae70c4cada44e01b1f2402ff8: Bootstrap starting.
I20260812 02:42:24.783193 12469 tablet_bootstrap.cc:654] T 96ba2ec489e144c59bce27967af3d2e6 P c6f990dae70c4cada44e01b1f2402ff8: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:24.784636 12469 log.cc:824] T 96ba2ec489e144c59bce27967af3d2e6 P c6f990dae70c4cada44e01b1f2402ff8: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:24.786397 12469 tablet_bootstrap.cc:492] T 96ba2ec489e144c59bce27967af3d2e6 P c6f990dae70c4cada44e01b1f2402ff8: No bootstrap required, opened a new log
I20260812 02:42:24.786618 12469 ts_tablet_manager.cc:1397] T 96ba2ec489e144c59bce27967af3d2e6 P c6f990dae70c4cada44e01b1f2402ff8: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 02:42:24.789254 12469 raft_consensus.cc:348] T 96ba2ec489e144c59bce27967af3d2e6 P c6f990dae70c4cada44e01b1f2402ff8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017e4ca67b9149f28330e8edd7b057bd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37313 } } peers { permanent_uuid: "c6f990dae70c4cada44e01b1f2402ff8" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42297 } } peers { permanent_uuid: "eeaea2c1d66b47e787830c3c739e5318" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36435 } }
I20260812 02:42:24.789512 12469 raft_consensus.cc:374] T 96ba2ec489e144c59bce27967af3d2e6 P c6f990dae70c4cada44e01b1f2402ff8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:24.789582 12469 raft_consensus.cc:729] T 96ba2ec489e144c59bce27967af3d2e6 P c6f990dae70c4cada44e01b1f2402ff8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6f990dae70c4cada44e01b1f2402ff8, State: Initialized, Role: FOLLOWER
I20260812 02:42:24.790017 12469 consensus_queue.cc:260] T 96ba2ec489e144c59bce27967af3d2e6 P c6f990dae70c4cada44e01b1f2402ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017e4ca67b9149f28330e8edd7b057bd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37313 } } peers { permanent_uuid: "c6f990dae70c4cada44e01b1f2402ff8" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42297 } } peers { permanent_uuid: "eeaea2c1d66b47e787830c3c739e5318" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36435 } }
I20260812 02:42:24.790640 12422 heartbeater.cc:503] Master 127.10.75.126:46511 was elected leader, sending a full tablet report...
I20260812 02:42:24.790831 12469 ts_tablet_manager.cc:1428] T 96ba2ec489e144c59bce27967af3d2e6 P c6f990dae70c4cada44e01b1f2402ff8: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260812 02:42:24.807670 12467 raft_consensus.cc:482] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:42:24.807933 12467 raft_consensus.cc:504] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017e4ca67b9149f28330e8edd7b057bd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37313 } } peers { permanent_uuid: "c6f990dae70c4cada44e01b1f2402ff8" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42297 } } peers { permanent_uuid: "eeaea2c1d66b47e787830c3c739e5318" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36435 } }
I20260812 02:42:24.809170 12467 leader_election.cc:288] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6f990dae70c4cada44e01b1f2402ff8 (127.10.75.67:42297), eeaea2c1d66b47e787830c3c739e5318 (127.10.75.66:36435)
I20260812 02:42:24.814464 12450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.809541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:60573 (local address 127.10.75.66:36435)
0812 02:42:24.809669 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:24.809673 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:24.809884 (+ 211us) server_negotiation.cc:407] Connection header received
0812 02:42:24.809946 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:24.809948 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:24.809991 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:24.810097 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:24.810494 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.811280 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.813071 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.813682 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.813808 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.813857 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:24.814253 (+ 396us) server_negotiation.cc:299] Negotiation successful
0812 02:42:24.814334 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 02:42:24.814464 12457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.809454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:39037 (local address 127.10.75.67:42297)
0812 02:42:24.809602 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:24.809607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:24.809783 (+ 176us) server_negotiation.cc:407] Connection header received
0812 02:42:24.809933 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:24.809936 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:24.809990 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:24.810097 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:24.810494 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.811275 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.813071 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.813699 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.813808 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.813857 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:24.814253 (+ 396us) server_negotiation.cc:299] Negotiation successful
0812 02:42:24.814334 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 02:42:24.814543 12474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.809333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:42297 (local address 127.10.75.65:39037)
0812 02:42:24.809682 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:24.809698 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:24.809815 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:24.810112 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:24.810115 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:24.810157 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:24.810378 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:24.810383 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.811414 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.811418 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:24.812943 (+ 1525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:24.812948 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.813831 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.813835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:24.814036 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.814140 (+ 104us) client_negotiation.cc:769] Sending connection context
0812 02:42:24.814223 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 02:42:24.814344 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"mutex_wait_us":264,"spinlock_wait_cycles":6272,"thread_start_us":107,"threads_started":1}
I20260812 02:42:24.815279 12334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ba2ec489e144c59bce27967af3d2e6" candidate_uuid: "017e4ca67b9149f28330e8edd7b057bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6f990dae70c4cada44e01b1f2402ff8" is_pre_election: true
I20260812 02:42:24.815557 12477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.809422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:36435 (local address 127.10.75.65:60573)
0812 02:42:24.809776 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:24.809788 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:24.809878 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:24.810112 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:24.810116 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:24.810156 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:24.810369 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:24.810377 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.811414 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.811418 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:24.812934 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:24.812947 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.813831 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.813835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:24.814032 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.814143 (+ 111us) client_negotiation.cc:769] Sending connection context
0812 02:42:24.814223 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 02:42:24.814344 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":245,"spinlock_wait_cycles":28032,"thread_start_us":122,"threads_started":1}
I20260812 02:42:24.815766 12334 raft_consensus.cc:2454] T 96ba2ec489e144c59bce27967af3d2e6 P c6f990dae70c4cada44e01b1f2402ff8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 017e4ca67b9149f28330e8edd7b057bd in term 0.
I20260812 02:42:24.816283 12079 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ba2ec489e144c59bce27967af3d2e6" candidate_uuid: "017e4ca67b9149f28330e8edd7b057bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeaea2c1d66b47e787830c3c739e5318" is_pre_election: true
I20260812 02:42:24.816398 11715 leader_election.cc:302] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017e4ca67b9149f28330e8edd7b057bd, c6f990dae70c4cada44e01b1f2402ff8; no voters:
I20260812 02:42:24.816543 12079 raft_consensus.cc:2454] T 96ba2ec489e144c59bce27967af3d2e6 P eeaea2c1d66b47e787830c3c739e5318 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 017e4ca67b9149f28330e8edd7b057bd in term 0.
I20260812 02:42:24.816743 12467 raft_consensus.cc:2781] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:42:24.816843 12467 raft_consensus.cc:482] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:42:24.816907 12467 raft_consensus.cc:3037] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:24.817992 12467 raft_consensus.cc:504] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017e4ca67b9149f28330e8edd7b057bd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37313 } } peers { permanent_uuid: "c6f990dae70c4cada44e01b1f2402ff8" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42297 } } peers { permanent_uuid: "eeaea2c1d66b47e787830c3c739e5318" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36435 } }
I20260812 02:42:24.818373 12467 leader_election.cc:288] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd [CANDIDATE]: Term 1 election: Requested vote from peers c6f990dae70c4cada44e01b1f2402ff8 (127.10.75.67:42297), eeaea2c1d66b47e787830c3c739e5318 (127.10.75.66:36435)
I20260812 02:42:24.818687 12334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ba2ec489e144c59bce27967af3d2e6" candidate_uuid: "017e4ca67b9149f28330e8edd7b057bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6f990dae70c4cada44e01b1f2402ff8"
I20260812 02:42:24.818748 12079 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ba2ec489e144c59bce27967af3d2e6" candidate_uuid: "017e4ca67b9149f28330e8edd7b057bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeaea2c1d66b47e787830c3c739e5318"
I20260812 02:42:24.818827 12334 raft_consensus.cc:3037] T 96ba2ec489e144c59bce27967af3d2e6 P c6f990dae70c4cada44e01b1f2402ff8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:24.818866 12079 raft_consensus.cc:3037] T 96ba2ec489e144c59bce27967af3d2e6 P eeaea2c1d66b47e787830c3c739e5318 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:24.819885 12079 raft_consensus.cc:2454] T 96ba2ec489e144c59bce27967af3d2e6 P eeaea2c1d66b47e787830c3c739e5318 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017e4ca67b9149f28330e8edd7b057bd in term 1.
I20260812 02:42:24.819893 12334 raft_consensus.cc:2454] T 96ba2ec489e144c59bce27967af3d2e6 P c6f990dae70c4cada44e01b1f2402ff8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 017e4ca67b9149f28330e8edd7b057bd in term 1.
I20260812 02:42:24.820245 11725 leader_election.cc:302] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 017e4ca67b9149f28330e8edd7b057bd, eeaea2c1d66b47e787830c3c739e5318; no voters:
I20260812 02:42:24.820410 12467 raft_consensus.cc:2781] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:24.820668 12467 raft_consensus.cc:686] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd [term 1 LEADER]: Becoming Leader. State: Replica: 017e4ca67b9149f28330e8edd7b057bd, State: Running, Role: LEADER
I20260812 02:42:24.821017 12467 consensus_queue.cc:237] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017e4ca67b9149f28330e8edd7b057bd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37313 } } peers { permanent_uuid: "c6f990dae70c4cada44e01b1f2402ff8" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42297 } } peers { permanent_uuid: "eeaea2c1d66b47e787830c3c739e5318" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36435 } }
I20260812 02:42:24.824224 11573 catalog_manager.cc:5495] T 96ba2ec489e144c59bce27967af3d2e6 P 017e4ca67b9149f28330e8edd7b057bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 017e4ca67b9149f28330e8edd7b057bd (127.10.75.65). New cstate: current_term: 1 leader_uuid: "017e4ca67b9149f28330e8edd7b057bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "017e4ca67b9149f28330e8edd7b057bd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6f990dae70c4cada44e01b1f2402ff8" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeaea2c1d66b47e787830c3c739e5318" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36435 } health_report { overall_health: UNKNOWN } } }
Aug 12 02:42:24 dist-test-slave-2p8l krb5kdc[11484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.65@KRBTEST.COM
I20260812 02:42:24.848145 12447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.838048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56538 (local address 127.10.75.65:37313)
0812 02:42:24.838224 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:24.838229 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:24.838376 (+ 147us) server_negotiation.cc:407] Connection header received
0812 02:42:24.838540 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:24.838543 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:24.838593 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:24.838699 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:24.839380 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.839892 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.840743 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.840961 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.841069 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.843869 (+ 2800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:24.843881 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:24.843900 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:24.843927 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:24.846329 (+ 2402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:24.846798 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:24.846805 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:24.846807 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:24.846897 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:24.847186 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:24.847190 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:24.847192 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:24.847453 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:24.847673 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:24.847846 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 02:42:24.847967 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 02:42:24 dist-test-slave-2p8l krb5kdc[11484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502544, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 02:42:24 dist-test-slave-2p8l krb5kdc[11484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502544, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.75.65@KRBTEST.COM
I20260812 02:42:24.877872 12447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.868962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56550 (local address 127.10.75.65:37313)
0812 02:42:24.869153 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:24.869158 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:24.869300 (+ 142us) server_negotiation.cc:407] Connection header received
0812 02:42:24.869479 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:24.869490 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:24.869537 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:24.869634 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:24.870436 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.871000 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.871926 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.872188 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.872313 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.874903 (+ 2590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:24.874907 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:24.874909 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:24.874931 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:24.876138 (+ 1207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:24.876567 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:24.876575 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:24.876577 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:24.876651 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:24.876973 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:24.876977 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:24.876979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:24.877152 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:24.877292 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:24.877584 (+ 292us) server_negotiation.cc:299] Negotiation successful
0812 02:42:24.877702 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
Aug 12 02:42:24 dist-test-slave-2p8l krb5kdc[11484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 02:42:24 dist-test-slave-2p8l krb5kdc[11484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.65@KRBTEST.COM
I20260812 02:42:24.904136 12447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:24.896267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56556 (local address 127.10.75.65:37313)
0812 02:42:24.896394 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:24.896398 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:24.896508 (+ 110us) server_negotiation.cc:407] Connection header received
0812 02:42:24.896605 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:24.896607 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:24.896649 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:24.896721 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:24.897367 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.897846 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.898715 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:24.898917 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:24.898994 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:24.901213 (+ 2219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:24.901216 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:24.901217 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:24.901239 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:24.902491 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:24.902957 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:24.902960 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:24.902961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:24.903030 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:24.903265 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:24.903267 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:24.903268 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:24.903415 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:24.903528 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:24.903717 (+ 189us) server_negotiation.cc:299] Negotiation successful
0812 02:42:24.903811 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
W20260812 02:42:24.905840 11768 tablet_service.cc:2908] Rejecting scan request for tablet 96ba2ec489e144c59bce27967af3d2e6: Uninitialized: clean time has not yet been initialized
I20260812 02:42:24.908136 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 11685
I20260812 02:42:24.921361 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 11933
I20260812 02:42:24.934824 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 12172
I20260812 02:42:24.945007 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 11508
2026-08-12T02:42:24Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2582 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:42:25 dist-test-slave-2p8l krb5kdc[12506](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:42:25 dist-test-slave-2p8l krb5kdc[12506](info): set up 2 sockets
Aug 12 02:42:25 dist-test-slave-2p8l krb5kdc[12506](info): commencing operation
krb5kdc: starting...
W20260812 02:42:26.251410 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:42:26 dist-test-slave-2p8l krb5kdc[12506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:42:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:42:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:42:26.375137 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:42743
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:41001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:42743
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:26.486135 12525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:26.486424 12525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:26.486511 12525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:26.490653 12525 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:42:26.490736 12525 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 02:42:26.490768 12525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:26.490810 12525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:26.490852 12525 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:42:26.490890 12525 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:42:26.496059 12525 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:41001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:42743
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:42743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:26.497064 12525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:26.498132 12525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:26.506430 12534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:26.506485 12538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:26.506412 12535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:26.506772 12525 server_base.cc:1034] running on GCE node
I20260812 02:42:26.507301 12525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:26.508315 12525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:26.509546 12525 hybrid_clock.cc:648] HybridClock initialized: now 1786502546509521 us; error 38 us; skew 500 ppm
Aug 12 02:42:26 dist-test-slave-2p8l krb5kdc[12506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502546, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:26.512465 12525 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:42:26.513453 12525 webserver.cc:460] Webserver started at http://127.10.75.126:36903/ using document root <none> and password file <none>
I20260812 02:42:26.514004 12525 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:26.514139 12525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:26.514392 12525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:26.516372 12525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "15e1bd530afc4a7f95c6dbb943b71694"
format_stamp: "Formatted at 2026-08-12 02:42:26 on dist-test-slave-2p8l"
server_key: "a6223a493adfe2f45de21f341699d81b"
server_key_iv: "1718574b4f2b32667955a8689a8bca36"
server_key_version: "encryptionkey@0"
I20260812 02:42:26.516937 12525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "15e1bd530afc4a7f95c6dbb943b71694"
format_stamp: "Formatted at 2026-08-12 02:42:26 on dist-test-slave-2p8l"
server_key: "a6223a493adfe2f45de21f341699d81b"
server_key_iv: "1718574b4f2b32667955a8689a8bca36"
server_key_version: "encryptionkey@0"
I20260812 02:42:26.520670 12525 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 02:42:26.523041 12549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:26.524178 12525 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:26.524325 12525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "15e1bd530afc4a7f95c6dbb943b71694"
format_stamp: "Formatted at 2026-08-12 02:42:26 on dist-test-slave-2p8l"
server_key: "a6223a493adfe2f45de21f341699d81b"
server_key_iv: "1718574b4f2b32667955a8689a8bca36"
server_key_version: "encryptionkey@0"
I20260812 02:42:26.524435 12525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:26.547006 12525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:26.550231 12525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:26.550450 12525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:26.560124 12525 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:42743
I20260812 02:42:26.560263 12658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:42743 every 8 connection(s)
I20260812 02:42:26.561215 12525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:42:26.563992 12660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:26.569690 12660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694: Bootstrap starting.
I20260812 02:42:26.571544 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 12525
I20260812 02:42:26.571671 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:42:26.571938 10541 external_mini_cluster.cc:1428] Setting key 8c08106310f5c8de77c8351e3cb3f231
I20260812 02:42:26.572589 12660 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:26.573562 12660 log.cc:824] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:26.575628 12660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694: No bootstrap required, opened a new log
I20260812 02:42:26.579185 12660 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15e1bd530afc4a7f95c6dbb943b71694" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42743 } }
I20260812 02:42:26.579433 12660 raft_consensus.cc:374] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:26.579532 12660 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15e1bd530afc4a7f95c6dbb943b71694, State: Initialized, Role: FOLLOWER
I20260812 02:42:26.579946 12660 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15e1bd530afc4a7f95c6dbb943b71694" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42743 } }
I20260812 02:42:26.580098 12660 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:42:26.580188 12660 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:42:26.580319 12660 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694 [term 0 FOLLOWER]: Advancing to term 1
Aug 12 02:42:26 dist-test-slave-2p8l krb5kdc[12506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:26.581292 12660 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15e1bd530afc4a7f95c6dbb943b71694" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42743 } }
I20260812 02:42:26.581634 12660 leader_election.cc:302] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15e1bd530afc4a7f95c6dbb943b71694; no voters:
I20260812 02:42:26.581952 12660 leader_election.cc:288] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:42:26.582046 12668 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:26.582299 12668 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694 [term 1 LEADER]: Becoming Leader. State: Replica: 15e1bd530afc4a7f95c6dbb943b71694, State: Running, Role: LEADER
I20260812 02:42:26.582614 12668 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15e1bd530afc4a7f95c6dbb943b71694" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42743 } }
I20260812 02:42:26.583312 12660 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:42:26.583829 12670 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15e1bd530afc4a7f95c6dbb943b71694. Latest consensus state: current_term: 1 leader_uuid: "15e1bd530afc4a7f95c6dbb943b71694" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15e1bd530afc4a7f95c6dbb943b71694" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42743 } } }
I20260812 02:42:26.583968 12670 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:26.584245 12669 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "15e1bd530afc4a7f95c6dbb943b71694" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15e1bd530afc4a7f95c6dbb943b71694" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42743 } } }
I20260812 02:42:26.584329 12669 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:26.584414 12679 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:42:26.587432 12679 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:42:26.587539 12665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:26.573123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53722 (local address 127.10.75.126:42743)
0812 02:42:26.573562 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:26.573577 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:26.573610 (+ 33us) server_negotiation.cc:407] Connection header received
0812 02:42:26.574546 (+ 936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:26.574567 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:26.574875 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:26.575213 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:26.576046 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:26.577000 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:26.577864 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:26.578409 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:26.578597 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:26.581355 (+ 2758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:26.581360 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:26.581372 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:26.581397 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:26.583587 (+ 2190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:26.584184 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:26.584191 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:26.584199 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:26.584361 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:26.584739 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:26.584742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:26.584743 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:26.585304 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:26.586166 (+ 862us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:26.586322 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 02:42:26.586626 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":129,"threads_started":1}
I20260812 02:42:26.593277 12679 catalog_manager.cc:1347] Generated new cluster ID: 364d7db12d28426fa59ac604c78bfbdd
I20260812 02:42:26.593348 12679 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:42:26.602356 12679 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:42:26.603305 12679 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:42:26.619136 12679 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694: Generated new TSK 0
I20260812 02:42:26.620225 12679 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
I20260812 02:42:26.657649 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:42743
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:41001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:26.768949 12709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:26.769178 12709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:26.769222 12709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:26.773103 12709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:26.773151 12709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:26.773195 12709 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 02:42:26.773226 12709 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:42:26.778187 12709 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:41001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.75.126:42743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12709
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:26.779035 12709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:26.780090 12709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:26.789570 12720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:26.789758 12717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:26.789582 12716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:26.789888 12709 server_base.cc:1034] running on GCE node
I20260812 02:42:26.790479 12709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:26.791132 12709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:26.792344 12709 hybrid_clock.cc:648] HybridClock initialized: now 1786502546792329 us; error 34 us; skew 500 ppm
Aug 12 02:42:26 dist-test-slave-2p8l krb5kdc[12506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502546, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:26.795224 12709 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:42:26.796069 12709 webserver.cc:460] Webserver started at http://127.10.75.65:44077/ using document root <none> and password file <none>
I20260812 02:42:26.796556 12709 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:26.796613 12709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:26.796767 12709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:26.798728 12709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "5d5ef850391a4908928fd407e151d4e4"
format_stamp: "Formatted at 2026-08-12 02:42:26 on dist-test-slave-2p8l"
server_key: "ab58c566700cdce65242cd90c6910295"
server_key_iv: "4547ff0396399975d81017a75586662a"
server_key_version: "encryptionkey@0"
I20260812 02:42:26.799238 12709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "5d5ef850391a4908928fd407e151d4e4"
format_stamp: "Formatted at 2026-08-12 02:42:26 on dist-test-slave-2p8l"
server_key: "ab58c566700cdce65242cd90c6910295"
server_key_iv: "4547ff0396399975d81017a75586662a"
server_key_version: "encryptionkey@0"
I20260812 02:42:26.802871 12709 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 02:42:26.805130 12728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:26.806391 12709 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:26.806493 12709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "5d5ef850391a4908928fd407e151d4e4"
format_stamp: "Formatted at 2026-08-12 02:42:26 on dist-test-slave-2p8l"
server_key: "ab58c566700cdce65242cd90c6910295"
server_key_iv: "4547ff0396399975d81017a75586662a"
server_key_version: "encryptionkey@0"
I20260812 02:42:26.806576 12709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:26.855728 12709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:26.858817 12709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:26.858983 12709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:26.860409 12709 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:26.860500 12709 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:26.860572 12709 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:26.860636 12709 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 02:42:26 dist-test-slave-2p8l krb5kdc[12506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502546, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:26.871902 12709 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:34739
I20260812 02:42:26.872052 12932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:34739 every 8 connection(s)
I20260812 02:42:26.873067 12709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:42:26.874482 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 12709
I20260812 02:42:26.874607 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:42:26.874905 10541 external_mini_cluster.cc:1428] Setting key 8172ef4c5a26f6cc7868e7baecbb28bf
I20260812 02:42:26.875355 12665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:26.861374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:49159 (local address 127.10.75.126:42743)
0812 02:42:26.861533 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:26.861538 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:26.862448 (+ 910us) server_negotiation.cc:407] Connection header received
0812 02:42:26.863550 (+ 1102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:26.863553 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:26.863612 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:26.863715 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:26.865301 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:26.866238 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:26.867403 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:26.867664 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:26.867784 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:26.871311 (+ 3527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:26.871314 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:26.871317 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:26.871345 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:26.873042 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:26.873644 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:26.873647 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:26.873649 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:26.873743 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:26.874151 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:26.874155 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:26.874156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:26.874345 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:26.874428 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:26.875077 (+ 649us) server_negotiation.cc:299] Negotiation successful
0812 02:42:26.875205 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 02:42:26.876286 12737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:26.861788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:42743 (local address 127.10.75.65:49159)
0812 02:42:26.862286 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:26.862336 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:26.863258 (+ 922us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:26.863905 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:26.863922 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:26.864444 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:26.865081 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:26.865100 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:26.866366 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:26.866370 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:26.867270 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:26.867280 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:26.867840 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:26.867844 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:26.868041 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:26.868630 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:26.868650 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:26.871143 (+ 2493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:26.873203 (+ 2060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:26.873211 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:26.873227 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:26.873484 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:26.873855 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:26.873860 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:26.873862 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:26.874021 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:26.874464 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:26.874471 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:26.874787 (+ 316us) client_negotiation.cc:769] Sending connection context
0812 02:42:26.874990 (+ 203us) client_negotiation.cc:240] Negotiation successful
0812 02:42:26.875310 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":138,"threads_started":1}
I20260812 02:42:26.877511 12933 heartbeater.cc:347] Connected to a master server at 127.10.75.126:42743
I20260812 02:42:26.877681 12933 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:26.878237 12933 heartbeater.cc:511] Master 127.10.75.126:42743 requested a full tablet report, sending...
I20260812 02:42:26.879876 12572 ts_manager.cc:194] Registered new tserver with Master: 5d5ef850391a4908928fd407e151d4e4 (127.10.75.65:34739)
I20260812 02:42:26.881007 12572 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:49159
WARNING: no policy specified for kudu/127.10.75.66@KRBTEST.COM; defaulting to no policy
I20260812 02:42:26.889307 12665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:26.881585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:50549 (local address 127.10.75.126:42743)
0812 02:42:26.881964 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:26.881968 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:26.881981 (+ 13us) server_negotiation.cc:407] Connection header received
0812 02:42:26.882015 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:26.882018 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:26.882056 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:26.882163 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:26.882776 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:26.883510 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:26.884855 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:26.885057 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:26.885139 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:26.886409 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:26.886412 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:26.886414 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:26.886435 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:26.887752 (+ 1317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:26.888127 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:26.888130 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:26.888132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:26.888201 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:26.888433 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:26.888436 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:26.888437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:26.888587 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:26.888681 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:26.889108 (+ 427us) server_negotiation.cc:299] Negotiation successful
0812 02:42:26.889202 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304}
I20260812 02:42:26.889411 12946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:26.880043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:42743 (local address 127.10.75.65:50549)
0812 02:42:26.880332 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:26.880349 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:26.880452 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:26.882194 (+ 1742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:26.882201 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:26.882428 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:26.882632 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:26.882643 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:26.883653 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:26.883660 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:26.884740 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:26.884753 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:26.885176 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:26.885181 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:26.885296 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:26.885787 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:26.885808 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:26.886278 (+ 470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:26.887849 (+ 1571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:26.887852 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:26.887853 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:26.888041 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:26.888279 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:26.888281 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:26.888283 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:26.888358 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:26.888838 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:26.888843 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:26.888956 (+ 113us) client_negotiation.cc:769] Sending connection context
0812 02:42:26.889050 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 02:42:26.889158 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":1,"thread_start_us":115,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
I20260812 02:42:26.905989 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:42743
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:41001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:27.017338 12949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:27.017590 12949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:27.017668 12949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:27.021643 12949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:27.021692 12949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:27.021745 12949 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 02:42:27.021777 12949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:42:27.026883 12949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:41001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.75.126:42743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:27.027866 12949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:27.028880 12949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:27.038235 12956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:27.038229 12955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:27.038368 12949 server_base.cc:1034] running on GCE node
W20260812 02:42:27.038307 12959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:27.038888 12949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:27.039515 12949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:27.040709 12949 hybrid_clock.cc:648] HybridClock initialized: now 1786502547040691 us; error 26 us; skew 500 ppm
Aug 12 02:42:27 dist-test-slave-2p8l krb5kdc[12506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502547, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:27.043397 12949 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:42:27.044154 12949 webserver.cc:460] Webserver started at http://127.10.75.66:43767/ using document root <none> and password file <none>
I20260812 02:42:27.044653 12949 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:27.044723 12949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:27.044878 12949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:27.046838 12949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "bf2e382677934e0d86e364ad941eca6e"
format_stamp: "Formatted at 2026-08-12 02:42:27 on dist-test-slave-2p8l"
server_key: "bc4b6039104a0111b84d73b43a0abeb4"
server_key_iv: "6566c72c16820811fa9785d56dd16038"
server_key_version: "encryptionkey@0"
I20260812 02:42:27.047545 12949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "bf2e382677934e0d86e364ad941eca6e"
format_stamp: "Formatted at 2026-08-12 02:42:27 on dist-test-slave-2p8l"
server_key: "bc4b6039104a0111b84d73b43a0abeb4"
server_key_iv: "6566c72c16820811fa9785d56dd16038"
server_key_version: "encryptionkey@0"
I20260812 02:42:27.053177 12949 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 02:42:27.056447 12974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:27.058631 12949 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260812 02:42:27.058772 12949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "bf2e382677934e0d86e364ad941eca6e"
format_stamp: "Formatted at 2026-08-12 02:42:27 on dist-test-slave-2p8l"
server_key: "bc4b6039104a0111b84d73b43a0abeb4"
server_key_iv: "6566c72c16820811fa9785d56dd16038"
server_key_version: "encryptionkey@0"
I20260812 02:42:27.058923 12949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:27.092765 12949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:27.096195 12949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:27.096350 12949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:27.097689 12949 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:27.097738 12949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:27.097806 12949 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:27.097841 12949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 02:42:27 dist-test-slave-2p8l krb5kdc[12506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502547, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:27.109500 12949 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:41735
I20260812 02:42:27.109531 13184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:41735 every 8 connection(s)
I20260812 02:42:27.110694 12949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:42:27.112174 12665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.098670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:36437 (local address 127.10.75.126:42743)
0812 02:42:27.098799 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:27.098803 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:27.099849 (+ 1046us) server_negotiation.cc:407] Connection header received
0812 02:42:27.100892 (+ 1043us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:27.100896 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:27.100959 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:27.101049 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:27.102496 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.103096 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.104487 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.104713 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.104830 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.108174 (+ 3344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:27.108178 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:27.108180 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:27.108213 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:27.110023 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:27.110592 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:27.110598 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:27.110603 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:27.110714 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:27.111073 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:27.111077 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:27.111081 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:27.111314 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:27.111424 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:27.111952 (+ 528us) server_negotiation.cc:299] Negotiation successful
0812 02:42:27.112051 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 02:42:27.112895 12995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.099192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:42743 (local address 127.10.75.66:36437)
0812 02:42:27.099694 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:27.099738 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:27.100638 (+ 900us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:27.101477 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:27.101485 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:27.101804 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:27.102334 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.102370 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.103230 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.103234 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.104314 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.104324 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.104869 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.104873 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.105084 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.106024 (+ 940us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:27.106051 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:27.107983 (+ 1932us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:27.110160 (+ 2177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:27.110164 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:27.110175 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:27.110486 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:27.110822 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:27.110826 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:27.110834 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:27.110963 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:27.111482 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:27.111489 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:27.111723 (+ 234us) client_negotiation.cc:769] Sending connection context
0812 02:42:27.111881 (+ 158us) client_negotiation.cc:240] Negotiation successful
0812 02:42:27.112106 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":137,"threads_started":1}
I20260812 02:42:27.114007 13186 heartbeater.cc:347] Connected to a master server at 127.10.75.126:42743
I20260812 02:42:27.114172 13186 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:27.114686 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 12949
I20260812 02:42:27.114802 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:42:27.114784 13186 heartbeater.cc:511] Master 127.10.75.126:42743 requested a full tablet report, sending...
I20260812 02:42:27.115101 10541 external_mini_cluster.cc:1428] Setting key 96614a133a602b3b9267599e1020949e
I20260812 02:42:27.115857 12576 ts_manager.cc:194] Registered new tserver with Master: bf2e382677934e0d86e364ad941eca6e (127.10.75.66:41735)
I20260812 02:42:27.116631 12576 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:36437
I20260812 02:42:27.124254 12665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.116365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:36845 (local address 127.10.75.126:42743)
0812 02:42:27.116471 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:27.116475 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:27.116705 (+ 230us) server_negotiation.cc:407] Connection header received
0812 02:42:27.116831 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:27.116834 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:27.116881 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:27.116964 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:27.117552 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.118334 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.119585 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.119926 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.120047 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.121075 (+ 1028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:27.121081 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:27.121084 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:27.121112 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:27.122590 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:27.123024 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:27.123028 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:27.123030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:27.123110 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:27.123397 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:27.123402 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:27.123404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:27.123611 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:27.123721 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:27.123988 (+ 267us) server_negotiation.cc:299] Negotiation successful
0812 02:42:27.124119 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 02:42:27.124251 13196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.116294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:42743 (local address 127.10.75.66:36845)
0812 02:42:27.116605 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:27.116617 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:27.116705 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:27.117078 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:27.117081 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:27.117293 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:27.117422 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.117432 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.118487 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.118494 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.119465 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.119480 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.120052 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.120055 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.120126 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.120569 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:27.120580 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:27.120923 (+ 343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:27.122711 (+ 1788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:27.122716 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:27.122718 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:27.122920 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:27.123212 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:27.123216 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:27.123218 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:27.123303 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:27.123726 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:27.123730 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:27.123822 (+ 92us) client_negotiation.cc:769] Sending connection context
0812 02:42:27.123931 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 02:42:27.124068 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":99,"threads_started":1}
WARNING: no policy specified for kudu/127.10.75.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
I20260812 02:42:27.144881 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:42743
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:41001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:27.255151 13200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:27.255373 13200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:27.255414 13200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:27.259346 13200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:27.259394 13200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:27.259431 13200 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 02:42:27.259518 13200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:42:27.264604 13200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:41001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.75.126:42743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:27.265636 13200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:27.266834 13200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:27.276036 13207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:27.276090 13211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:27.276121 13200 server_base.cc:1034] running on GCE node
W20260812 02:42:27.276324 13216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:27.276752 13200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:27.277365 13200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:27.278546 13200 hybrid_clock.cc:648] HybridClock initialized: now 1786502547278529 us; error 30 us; skew 500 ppm
Aug 12 02:42:27 dist-test-slave-2p8l krb5kdc[12506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502547, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:27.281764 13200 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:42:27.282685 13200 webserver.cc:460] Webserver started at http://127.10.75.67:41763/ using document root <none> and password file <none>
I20260812 02:42:27.283231 13200 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:27.283324 13200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:27.283610 13200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:27.285770 13200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "95544622803a4c4f9c312d20df24a4a6"
format_stamp: "Formatted at 2026-08-12 02:42:27 on dist-test-slave-2p8l"
server_key: "956fc12310dd66a982bc0224d5068bb8"
server_key_iv: "b3851eabb1252c3486e130dbd43525aa"
server_key_version: "encryptionkey@0"
I20260812 02:42:27.286425 13200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "95544622803a4c4f9c312d20df24a4a6"
format_stamp: "Formatted at 2026-08-12 02:42:27 on dist-test-slave-2p8l"
server_key: "956fc12310dd66a982bc0224d5068bb8"
server_key_iv: "b3851eabb1252c3486e130dbd43525aa"
server_key_version: "encryptionkey@0"
I20260812 02:42:27.289964 13200 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:42:27.292348 13226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:27.293493 13200 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:42:27.293641 13200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "95544622803a4c4f9c312d20df24a4a6"
format_stamp: "Formatted at 2026-08-12 02:42:27 on dist-test-slave-2p8l"
server_key: "956fc12310dd66a982bc0224d5068bb8"
server_key_iv: "b3851eabb1252c3486e130dbd43525aa"
server_key_version: "encryptionkey@0"
I20260812 02:42:27.293746 13200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:27.318225 13200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:27.321411 13200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:27.321615 13200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:27.323098 13200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:27.323175 13200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:27.323249 13200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:27.323295 13200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 02:42:27 dist-test-slave-2p8l krb5kdc[12506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502547, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:27.334492 13200 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:37963
I20260812 02:42:27.334575 13434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:37963 every 8 connection(s)
I20260812 02:42:27.335606 13200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:42:27.337710 12665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.323991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:35751 (local address 127.10.75.126:42743)
0812 02:42:27.324120 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:27.324124 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:27.325182 (+ 1058us) server_negotiation.cc:407] Connection header received
0812 02:42:27.326269 (+ 1087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:27.326272 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:27.326338 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:27.326408 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:27.328208 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.329117 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.330944 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.331300 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.331423 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.333943 (+ 2520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:27.333950 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:27.333956 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:27.333990 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:27.335708 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:27.336321 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:27.336325 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:27.336326 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:27.336419 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:27.336784 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:27.336787 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:27.336788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:27.336984 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:27.337063 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:27.337496 (+ 433us) server_negotiation.cc:299] Negotiation successful
0812 02:42:27.337593 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 02:42:27.338524 13245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.324541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:42743 (local address 127.10.75.67:35751)
0812 02:42:27.325027 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:27.325067 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:27.325983 (+ 916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:27.326879 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:27.326889 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:27.327330 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:27.328034 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.328057 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.329257 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.329263 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.330784 (+ 1521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.330796 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.331450 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.331453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.331587 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.332258 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:27.332282 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:27.333762 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:27.335814 (+ 2052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:27.335819 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:27.335830 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:27.336154 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:27.336540 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:27.336546 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:27.336549 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:27.336687 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:27.337060 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:27.337064 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:27.337283 (+ 219us) client_negotiation.cc:769] Sending connection context
0812 02:42:27.337446 (+ 163us) client_negotiation.cc:240] Negotiation successful
0812 02:42:27.337673 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":142,"threads_started":1}
I20260812 02:42:27.339788 13435 heartbeater.cc:347] Connected to a master server at 127.10.75.126:42743
I20260812 02:42:27.339951 13435 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:27.340422 13435 heartbeater.cc:511] Master 127.10.75.126:42743 requested a full tablet report, sending...
I20260812 02:42:27.340894 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 13200
I20260812 02:42:27.341017 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:42:27.341344 10541 external_mini_cluster.cc:1428] Setting key bf45eb093af74c83a896280eff2ca192
I20260812 02:42:27.341569 12576 ts_manager.cc:194] Registered new tserver with Master: 95544622803a4c4f9c312d20df24a4a6 (127.10.75.67:37963)
I20260812 02:42:27.342353 12576 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:35751
I20260812 02:42:27.343505 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:42:27.352361 13448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.341902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:42743 (local address 127.10.75.67:59575)
0812 02:42:27.342320 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:27.342340 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:27.342465 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:27.343014 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:27.343017 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:27.343226 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:27.343427 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.345816 (+ 2389us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.346910 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.346912 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.347451 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.347459 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.348096 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.348099 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.348166 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.348705 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:27.348716 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:27.349010 (+ 294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:27.350797 (+ 1787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:27.350802 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:27.350804 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:27.351002 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:27.351363 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:27.351369 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:27.351372 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:27.351479 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:27.351950 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:27.351952 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:27.352036 (+ 84us) client_negotiation.cc:769] Sending connection context
0812 02:42:27.352121 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 02:42:27.352229 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"mutex_wait_us":10,"thread_start_us":95,"threads_started":1}
I20260812 02:42:27.352557 12665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.342127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:59575 (local address 127.10.75.126:42743)
0812 02:42:27.342252 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:27.342257 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:27.342435 (+ 178us) server_negotiation.cc:407] Connection header received
0812 02:42:27.342560 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:27.342562 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:27.342606 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:27.342686 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:27.345943 (+ 3257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.346785 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.347576 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.347968 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.348105 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.349150 (+ 1045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:27.349157 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:27.349162 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:27.349196 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:27.350678 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:27.351111 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:27.351115 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:27.351117 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:27.351204 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:27.351603 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:27.351608 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:27.351612 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:27.351848 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:27.351956 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:27.352217 (+ 261us) server_negotiation.cc:299] Negotiation successful
0812 02:42:27.352365 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
Aug 12 02:42:27 dist-test-slave-2p8l krb5kdc[12506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502547, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 02:42:27 dist-test-slave-2p8l krb5kdc[12506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502547, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:27.371179 12665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.363503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53730 (local address 127.10.75.126:42743)
0812 02:42:27.363624 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:27.363628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:27.363639 (+ 11us) server_negotiation.cc:407] Connection header received
0812 02:42:27.363674 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:27.363676 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:27.363712 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:27.363778 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:27.364450 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.364994 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.365866 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.366110 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.366208 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.368402 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:27.368405 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:27.368407 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:27.368430 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:27.369650 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:27.370027 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:27.370029 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:27.370030 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:27.370159 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:27.370411 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:27.370413 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:27.370414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:27.370662 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:27.370772 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:27.370968 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 02:42:27.371060 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 02:42:27.373972 12576 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53730:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:42:27.377329 12576 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:42:27.392079 13471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.385764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59884 (local address 127.10.75.67:37963)
0812 02:42:27.386554 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:27.386576 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:27.387224 (+ 648us) server_negotiation.cc:407] Connection header received
0812 02:42:27.387439 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:27.387446 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:27.387661 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:27.387847 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:27.388182 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.389158 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.390682 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.391213 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.391342 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.391604 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:27.391827 (+ 223us) server_negotiation.cc:299] Negotiation successful
0812 02:42:27.391921 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":122,"threads_started":1}
I20260812 02:42:27.392067 13468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.385642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:37963 (local address 127.0.0.1:59884)
0812 02:42:27.387076 (+ 1434us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:27.387125 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:27.387275 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:27.387835 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:27.387841 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:27.387863 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:27.388015 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.388021 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.389305 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.389307 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.390550 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.390559 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.391343 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.391347 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.391459 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.391637 (+ 178us) client_negotiation.cc:769] Sending connection context
0812 02:42:27.391794 (+ 157us) client_negotiation.cc:240] Negotiation successful
0812 02:42:27.391915 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1238,"mutex_wait_us":3,"spinlock_wait_cycles":9088,"thread_start_us":91,"threads_started":1}
I20260812 02:42:27.392632 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.386472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56490 (local address 127.10.75.65:34739)
0812 02:42:27.386804 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:27.386813 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:27.387620 (+ 807us) server_negotiation.cc:407] Connection header received
0812 02:42:27.387772 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:27.387778 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:27.387974 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:27.388120 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:27.388390 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.389564 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.390992 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.391772 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.391874 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.392005 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:27.392372 (+ 367us) server_negotiation.cc:299] Negotiation successful
0812 02:42:27.392480 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":111,"threads_started":1}
I20260812 02:42:27.393028 13473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.385758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:34739 (local address 127.0.0.1:56490)
0812 02:42:27.387519 (+ 1761us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:27.387531 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:27.387616 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:27.388122 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:27.388127 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:27.388151 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:27.388265 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.388271 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.389879 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.389883 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.390859 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.390870 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.392065 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.392070 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.392212 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.392235 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 02:42:27.392813 (+ 578us) client_negotiation.cc:240] Negotiation successful
0812 02:42:27.392890 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1700,"mutex_wait_us":56,"thread_start_us":82,"threads_started":1}
I20260812 02:42:27.393805 13464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.386146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:41735 (local address 127.0.0.1:59642)
0812 02:42:27.387806 (+ 1660us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:27.387820 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:27.387912 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:27.388445 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:27.388448 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:27.388465 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:27.388540 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.388545 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.389879 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.389882 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.392031 (+ 2149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.392043 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.393403 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.393406 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.393494 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.393516 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 02:42:27.393588 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 02:42:27.393667 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1596,"mutex_wait_us":917,"thread_start_us":101,"threads_started":1}
I20260812 02:42:27.394255 13475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.386319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59642 (local address 127.10.75.66:41735)
0812 02:42:27.386723 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:27.386735 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:27.388014 (+ 1279us) server_negotiation.cc:407] Connection header received
0812 02:42:27.388102 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:27.388107 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:27.388300 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:27.388482 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:27.388618 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.389743 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.392188 (+ 2445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.393057 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.393169 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.393335 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:27.394001 (+ 666us) server_negotiation.cc:299] Negotiation successful
0812 02:42:27.394144 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":115,"threads_started":1}
I20260812 02:42:27.395484 13321 tablet_service.cc:1467] Processing CreateTablet for tablet ca8fb3445ef34ae5b48406df3d4e645b (DEFAULT_TABLE table=test-table [id=413381d2e08c4234bd56786c12533b39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:27.395586 12828 tablet_service.cc:1467] Processing CreateTablet for tablet ca8fb3445ef34ae5b48406df3d4e645b (DEFAULT_TABLE table=test-table [id=413381d2e08c4234bd56786c12533b39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:27.396217 13067 tablet_service.cc:1467] Processing CreateTablet for tablet ca8fb3445ef34ae5b48406df3d4e645b (DEFAULT_TABLE table=test-table [id=413381d2e08c4234bd56786c12533b39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:27.396674 13321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca8fb3445ef34ae5b48406df3d4e645b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:27.396674 12828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca8fb3445ef34ae5b48406df3d4e645b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:27.397113 13067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca8fb3445ef34ae5b48406df3d4e645b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:27.403788 13482 tablet_bootstrap.cc:492] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e: Bootstrap starting.
I20260812 02:42:27.404958 13484 tablet_bootstrap.cc:492] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6: Bootstrap starting.
I20260812 02:42:27.405879 13482 tablet_bootstrap.cc:654] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:27.406361 13483 tablet_bootstrap.cc:492] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4: Bootstrap starting.
I20260812 02:42:27.406692 13482 log.cc:824] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:27.406867 13484 tablet_bootstrap.cc:654] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:27.407691 13484 log.cc:824] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:27.408442 13483 tablet_bootstrap.cc:654] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:27.408952 13482 tablet_bootstrap.cc:492] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e: No bootstrap required, opened a new log
I20260812 02:42:27.409116 13483 log.cc:824] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:27.409154 13482 ts_tablet_manager.cc:1397] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 02:42:27.409696 13484 tablet_bootstrap.cc:492] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6: No bootstrap required, opened a new log
I20260812 02:42:27.409875 13484 ts_tablet_manager.cc:1397] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 02:42:27.410892 13483 tablet_bootstrap.cc:492] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4: No bootstrap required, opened a new log
I20260812 02:42:27.411083 13483 ts_tablet_manager.cc:1397] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 02:42:27.413080 13482 raft_consensus.cc:348] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } } peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } }
I20260812 02:42:27.413343 13482 raft_consensus.cc:374] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:27.413404 13482 raft_consensus.cc:729] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2e382677934e0d86e364ad941eca6e, State: Initialized, Role: FOLLOWER
I20260812 02:42:27.413745 13484 raft_consensus.cc:348] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } } peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } }
I20260812 02:42:27.413843 13482 consensus_queue.cc:260] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } } peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } }
I20260812 02:42:27.413980 13484 raft_consensus.cc:374] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:27.414040 13484 raft_consensus.cc:729] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95544622803a4c4f9c312d20df24a4a6, State: Initialized, Role: FOLLOWER
I20260812 02:42:27.414615 13186 heartbeater.cc:503] Master 127.10.75.126:42743 was elected leader, sending a full tablet report...
I20260812 02:42:27.414623 13483 raft_consensus.cc:348] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } } peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } }
I20260812 02:42:27.414852 13483 raft_consensus.cc:374] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:27.414908 13483 raft_consensus.cc:729] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5ef850391a4908928fd407e151d4e4, State: Initialized, Role: FOLLOWER
I20260812 02:42:27.414938 13482 ts_tablet_manager.cc:1428] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260812 02:42:27.415307 13483 consensus_queue.cc:260] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } } peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } }
I20260812 02:42:27.415318 13484 consensus_queue.cc:260] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } } peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } }
I20260812 02:42:27.415932 12933 heartbeater.cc:503] Master 127.10.75.126:42743 was elected leader, sending a full tablet report...
I20260812 02:42:27.416188 13483 ts_tablet_manager.cc:1428] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 02:42:27.416257 13484 ts_tablet_manager.cc:1428] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260812 02:42:27.416675 13435 heartbeater.cc:503] Master 127.10.75.126:42743 was elected leader, sending a full tablet report...
I20260812 02:42:27.524981 13489 raft_consensus.cc:482] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:42:27.525254 13489 raft_consensus.cc:504] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } } peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } }
I20260812 02:42:27.526489 13489 leader_election.cc:288] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95544622803a4c4f9c312d20df24a4a6 (127.10.75.67:37963), 5d5ef850391a4908928fd407e151d4e4 (127.10.75.65:34739)
I20260812 02:42:27.530638 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.526973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:38747 (local address 127.10.75.65:34739)
0812 02:42:27.527125 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:27.527132 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:27.527152 (+ 20us) server_negotiation.cc:407] Connection header received
0812 02:42:27.527275 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:27.527279 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:27.527331 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:27.527415 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:27.527726 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.528279 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.529613 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.530032 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.530223 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.530291 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:27.530466 (+ 175us) server_negotiation.cc:299] Negotiation successful
0812 02:42:27.530535 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 02:42:27.530640 12995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.526798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:34739 (local address 127.10.75.66:38747)
0812 02:42:27.527024 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:27.527040 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:27.527143 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:27.527436 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:27.527438 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:27.527456 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:27.527578 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.527585 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.528400 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.528405 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.529488 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.529499 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.530222 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.530225 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.530329 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.530355 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 02:42:27.530435 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 02:42:27.530505 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144}
I20260812 02:42:27.531424 12858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca8fb3445ef34ae5b48406df3d4e645b" candidate_uuid: "bf2e382677934e0d86e364ad941eca6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5ef850391a4908928fd407e151d4e4" is_pre_election: true
I20260812 02:42:27.531729 12858 raft_consensus.cc:2454] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf2e382677934e0d86e364ad941eca6e in term 0.
I20260812 02:42:27.532258 12980 leader_election.cc:302] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d5ef850391a4908928fd407e151d4e4, bf2e382677934e0d86e364ad941eca6e; no voters:
I20260812 02:42:27.532516 13489 raft_consensus.cc:2781] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:42:27.532642 13489 raft_consensus.cc:482] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:42:27.532730 13489 raft_consensus.cc:3037] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:27.533011 13471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.527020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:39669 (local address 127.10.75.67:37963)
0812 02:42:27.527359 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:27.527365 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:27.529109 (+ 1744us) server_negotiation.cc:407] Connection header received
0812 02:42:27.529202 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:27.529206 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:27.529253 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:27.529330 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:27.530087 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.530803 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.531904 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.532317 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.532465 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.532516 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:27.532824 (+ 308us) server_negotiation.cc:299] Negotiation successful
0812 02:42:27.532898 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245}
I20260812 02:42:27.533037 13492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.526804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:37963 (local address 127.10.75.66:39669)
0812 02:42:27.529013 (+ 2209us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:27.529025 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:27.529113 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:27.529353 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:27.529355 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:27.529368 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:27.529924 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.529931 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.530926 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.530930 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.531763 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.531773 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.532547 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.532551 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.532635 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.532655 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 02:42:27.532798 (+ 143us) client_negotiation.cc:240] Negotiation successful
0812 02:42:27.532869 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2153,"mutex_wait_us":363,"thread_start_us":1626,"threads_started":1}
I20260812 02:42:27.533597 13354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca8fb3445ef34ae5b48406df3d4e645b" candidate_uuid: "bf2e382677934e0d86e364ad941eca6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95544622803a4c4f9c312d20df24a4a6" is_pre_election: true
I20260812 02:42:27.533907 13354 raft_consensus.cc:2454] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf2e382677934e0d86e364ad941eca6e in term 0.
I20260812 02:42:27.534413 13489 raft_consensus.cc:504] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } } peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } }
I20260812 02:42:27.534759 13489 leader_election.cc:288] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [CANDIDATE]: Term 1 election: Requested vote from peers 95544622803a4c4f9c312d20df24a4a6 (127.10.75.67:37963), 5d5ef850391a4908928fd407e151d4e4 (127.10.75.65:34739)
I20260812 02:42:27.535125 13354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca8fb3445ef34ae5b48406df3d4e645b" candidate_uuid: "bf2e382677934e0d86e364ad941eca6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95544622803a4c4f9c312d20df24a4a6"
I20260812 02:42:27.535140 12858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca8fb3445ef34ae5b48406df3d4e645b" candidate_uuid: "bf2e382677934e0d86e364ad941eca6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5ef850391a4908928fd407e151d4e4"
I20260812 02:42:27.535223 13354 raft_consensus.cc:3037] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:27.535275 12858 raft_consensus.cc:3037] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:27.536319 12858 raft_consensus.cc:2454] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2e382677934e0d86e364ad941eca6e in term 1.
I20260812 02:42:27.536659 13354 raft_consensus.cc:2454] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2e382677934e0d86e364ad941eca6e in term 1.
I20260812 02:42:27.536689 12980 leader_election.cc:302] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d5ef850391a4908928fd407e151d4e4, bf2e382677934e0d86e364ad941eca6e; no voters:
I20260812 02:42:27.536855 13489 raft_consensus.cc:2781] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:27.537083 13489 raft_consensus.cc:686] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [term 1 LEADER]: Becoming Leader. State: Replica: bf2e382677934e0d86e364ad941eca6e, State: Running, Role: LEADER
I20260812 02:42:27.537432 13489 consensus_queue.cc:237] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } } peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } }
I20260812 02:42:27.540560 12572 catalog_manager.cc:5495] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e reported cstate change: term changed from 0 to 1, leader changed from <none> to bf2e382677934e0d86e364ad941eca6e (127.10.75.66). New cstate: current_term: 1 leader_uuid: "bf2e382677934e0d86e364ad941eca6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } health_report { overall_health: HEALTHY } } }
I20260812 02:42:27.585011 13475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.581309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59648 (local address 127.10.75.66:41735)
0812 02:42:27.581435 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:27.581439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:27.581452 (+ 13us) server_negotiation.cc:407] Connection header received
0812 02:42:27.581642 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:27.581644 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:27.581702 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:27.581786 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:42:27.582029 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.582557 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.583471 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.583675 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.583770 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.584103 (+ 333us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:42:27.584612 (+ 509us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:42:27.584703 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:27.584786 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 02:42:27.584836 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260812 02:42:27.586784 13436 tablet.cc:2369] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:42:27.591132 12858 raft_consensus.cc:1261] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4 [term 1 FOLLOWER]: Refusing update from remote peer bf2e382677934e0d86e364ad941eca6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:42:27.591810 13489 consensus_queue.cc:1035] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:27.593057 13354 raft_consensus.cc:1261] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6 [term 1 FOLLOWER]: Refusing update from remote peer bf2e382677934e0d86e364ad941eca6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:42:27.593632 13494 consensus_queue.cc:1035] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:27.613615 12572 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:42:27.613893 12572 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:42:27.616460 12572 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694: Sending DeleteTablet for 3 replicas of tablet ca8fb3445ef34ae5b48406df3d4e645b
I20260812 02:42:27.617259 13321 tablet_service.cc:1514] Processing DeleteTablet for tablet ca8fb3445ef34ae5b48406df3d4e645b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:27 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:59884
I20260812 02:42:27.617314 13067 tablet_service.cc:1514] Processing DeleteTablet for tablet ca8fb3445ef34ae5b48406df3d4e645b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:27 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:59642
I20260812 02:42:27.617689 12828 tablet_service.cc:1514] Processing DeleteTablet for tablet ca8fb3445ef34ae5b48406df3d4e645b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:27 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:56490
I20260812 02:42:27.617779 13517 tablet_replica.cc:330] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6: stopping tablet replica
I20260812 02:42:27.618007 13517 raft_consensus.cc:2229] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:42:27.618249 13517 raft_consensus.cc:2258] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:27.618516 13519 tablet_replica.cc:330] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e: stopping tablet replica
I20260812 02:42:27.618700 13519 raft_consensus.cc:2229] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:42:27.618954 13519 raft_consensus.cc:2258] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:27.619258 12572 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53730:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:42:27.619656 12572 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:42:27.620191 13520 tablet_replica.cc:330] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4: stopping tablet replica
I20260812 02:42:27.620951 13519 ts_tablet_manager.cc:1905] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:27.620992 13520 raft_consensus.cc:2229] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:42:27.621955 13520 raft_consensus.cc:2258] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:27.621992 13517 ts_tablet_manager.cc:1905] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:27.623265 13520 ts_tablet_manager.cc:1905] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:27.625038 13321 tablet_service.cc:1467] Processing CreateTablet for tablet a6909b1df62448749260ebe8dc446fd6 (DEFAULT_TABLE table=test-table [id=edad5d1b182842dc9bff5749b504d104]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:27.625228 13067 tablet_service.cc:1467] Processing CreateTablet for tablet a6909b1df62448749260ebe8dc446fd6 (DEFAULT_TABLE table=test-table [id=edad5d1b182842dc9bff5749b504d104]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:27.625308 13321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6909b1df62448749260ebe8dc446fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:27.625607 12828 tablet_service.cc:1467] Processing CreateTablet for tablet a6909b1df62448749260ebe8dc446fd6 (DEFAULT_TABLE table=test-table [id=edad5d1b182842dc9bff5749b504d104]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:27.625828 12828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6909b1df62448749260ebe8dc446fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:27.626114 13520 ts_tablet_manager.cc:1918] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:42:27.626207 13520 log.cc:1196] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-0/wal/wals/ca8fb3445ef34ae5b48406df3d4e645b
I20260812 02:42:27.626605 13520 ts_tablet_manager.cc:1939] T ca8fb3445ef34ae5b48406df3d4e645b P 5d5ef850391a4908928fd407e151d4e4: Deleting consensus metadata
I20260812 02:42:27.627967 13483 tablet_bootstrap.cc:492] T a6909b1df62448749260ebe8dc446fd6 P 5d5ef850391a4908928fd407e151d4e4: Bootstrap starting.
I20260812 02:42:27.627965 13484 tablet_bootstrap.cc:492] T a6909b1df62448749260ebe8dc446fd6 P 95544622803a4c4f9c312d20df24a4a6: Bootstrap starting.
I20260812 02:42:27.628186 12553 catalog_manager.cc:4841] TS 5d5ef850391a4908928fd407e151d4e4 (127.10.75.65:34739): tablet ca8fb3445ef34ae5b48406df3d4e645b (table test-table [id=413381d2e08c4234bd56786c12533b39]) successfully deleted
I20260812 02:42:27.628932 13484 tablet_bootstrap.cc:654] T a6909b1df62448749260ebe8dc446fd6 P 95544622803a4c4f9c312d20df24a4a6: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:27.628929 13483 tablet_bootstrap.cc:654] T a6909b1df62448749260ebe8dc446fd6 P 5d5ef850391a4908928fd407e151d4e4: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:27.630339 13484 tablet_bootstrap.cc:492] T a6909b1df62448749260ebe8dc446fd6 P 95544622803a4c4f9c312d20df24a4a6: No bootstrap required, opened a new log
I20260812 02:42:27.630427 13483 tablet_bootstrap.cc:492] T a6909b1df62448749260ebe8dc446fd6 P 5d5ef850391a4908928fd407e151d4e4: No bootstrap required, opened a new log
I20260812 02:42:27.630430 13484 ts_tablet_manager.cc:1397] T a6909b1df62448749260ebe8dc446fd6 P 95544622803a4c4f9c312d20df24a4a6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20260812 02:42:27.630502 13483 ts_tablet_manager.cc:1397] T a6909b1df62448749260ebe8dc446fd6 P 5d5ef850391a4908928fd407e151d4e4: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 02:42:27.630887 13484 raft_consensus.cc:348] T a6909b1df62448749260ebe8dc446fd6 P 95544622803a4c4f9c312d20df24a4a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } }
I20260812 02:42:27.630983 13484 raft_consensus.cc:374] T a6909b1df62448749260ebe8dc446fd6 P 95544622803a4c4f9c312d20df24a4a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:27.631012 13484 raft_consensus.cc:729] T a6909b1df62448749260ebe8dc446fd6 P 95544622803a4c4f9c312d20df24a4a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95544622803a4c4f9c312d20df24a4a6, State: Initialized, Role: FOLLOWER
I20260812 02:42:27.631129 13484 consensus_queue.cc:260] T a6909b1df62448749260ebe8dc446fd6 P 95544622803a4c4f9c312d20df24a4a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } }
I20260812 02:42:27.631263 13483 raft_consensus.cc:348] T a6909b1df62448749260ebe8dc446fd6 P 5d5ef850391a4908928fd407e151d4e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } }
I20260812 02:42:27.631364 13483 raft_consensus.cc:374] T a6909b1df62448749260ebe8dc446fd6 P 5d5ef850391a4908928fd407e151d4e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:27.631390 13484 ts_tablet_manager.cc:1428] T a6909b1df62448749260ebe8dc446fd6 P 95544622803a4c4f9c312d20df24a4a6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 02:42:27.631394 13483 raft_consensus.cc:729] T a6909b1df62448749260ebe8dc446fd6 P 5d5ef850391a4908928fd407e151d4e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5ef850391a4908928fd407e151d4e4, State: Initialized, Role: FOLLOWER
I20260812 02:42:27.631537 13483 consensus_queue.cc:260] T a6909b1df62448749260ebe8dc446fd6 P 5d5ef850391a4908928fd407e151d4e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } }
I20260812 02:42:27.632349 13067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6909b1df62448749260ebe8dc446fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:27.632694 13517 ts_tablet_manager.cc:1918] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:42:27.632802 13517 log.cc:1196] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/ca8fb3445ef34ae5b48406df3d4e645b
I20260812 02:42:27.633143 13517 ts_tablet_manager.cc:1939] T ca8fb3445ef34ae5b48406df3d4e645b P 95544622803a4c4f9c312d20df24a4a6: Deleting consensus metadata
I20260812 02:42:27.634696 13482 tablet_bootstrap.cc:492] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e: Bootstrap starting.
I20260812 02:42:27.635252 13519 ts_tablet_manager.cc:1918] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:42:27.635354 13519 log.cc:1196] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/ca8fb3445ef34ae5b48406df3d4e645b
I20260812 02:42:27.635716 13519 ts_tablet_manager.cc:1939] T ca8fb3445ef34ae5b48406df3d4e645b P bf2e382677934e0d86e364ad941eca6e: Deleting consensus metadata
I20260812 02:42:27.635761 13482 tablet_bootstrap.cc:654] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:27.635820 13483 ts_tablet_manager.cc:1428] T a6909b1df62448749260ebe8dc446fd6 P 5d5ef850391a4908928fd407e151d4e4: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260812 02:42:27.637048 13482 tablet_bootstrap.cc:492] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e: No bootstrap required, opened a new log
I20260812 02:42:27.637131 13482 ts_tablet_manager.cc:1397] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260812 02:42:27.637228 12555 catalog_manager.cc:4841] TS bf2e382677934e0d86e364ad941eca6e (127.10.75.66:41735): tablet ca8fb3445ef34ae5b48406df3d4e645b (table test-table [id=413381d2e08c4234bd56786c12533b39]) successfully deleted
I20260812 02:42:27.637568 13482 raft_consensus.cc:348] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } }
I20260812 02:42:27.637663 13482 raft_consensus.cc:374] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:27.637689 13482 raft_consensus.cc:729] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2e382677934e0d86e364ad941eca6e, State: Initialized, Role: FOLLOWER
I20260812 02:42:27.637811 13482 consensus_queue.cc:260] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } }
I20260812 02:42:27.638069 13482 ts_tablet_manager.cc:1428] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 02:42:27.638252 12551 catalog_manager.cc:4841] TS 95544622803a4c4f9c312d20df24a4a6 (127.10.75.67:37963): tablet ca8fb3445ef34ae5b48406df3d4e645b (table test-table [id=413381d2e08c4234bd56786c12533b39]) successfully deleted
I20260812 02:42:27.652794 13494 raft_consensus.cc:482] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:42:27.652890 13494 raft_consensus.cc:504] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } }
I20260812 02:42:27.653323 13494 leader_election.cc:288] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d5ef850391a4908928fd407e151d4e4 (127.10.75.65:34739), 95544622803a4c4f9c312d20df24a4a6 (127.10.75.67:37963)
I20260812 02:42:27.653697 12858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6909b1df62448749260ebe8dc446fd6" candidate_uuid: "bf2e382677934e0d86e364ad941eca6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5ef850391a4908928fd407e151d4e4" is_pre_election: true
I20260812 02:42:27.653697 13354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6909b1df62448749260ebe8dc446fd6" candidate_uuid: "bf2e382677934e0d86e364ad941eca6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95544622803a4c4f9c312d20df24a4a6" is_pre_election: true
I20260812 02:42:27.653836 13354 raft_consensus.cc:2454] T a6909b1df62448749260ebe8dc446fd6 P 95544622803a4c4f9c312d20df24a4a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf2e382677934e0d86e364ad941eca6e in term 0.
I20260812 02:42:27.653836 12858 raft_consensus.cc:2454] T a6909b1df62448749260ebe8dc446fd6 P 5d5ef850391a4908928fd407e151d4e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf2e382677934e0d86e364ad941eca6e in term 0.
I20260812 02:42:27.654170 12980 leader_election.cc:302] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d5ef850391a4908928fd407e151d4e4, bf2e382677934e0d86e364ad941eca6e; no voters:
I20260812 02:42:27.654335 13494 raft_consensus.cc:2781] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:42:27.654393 13494 raft_consensus.cc:482] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:42:27.654469 13494 raft_consensus.cc:3037] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:27.655387 13494 raft_consensus.cc:504] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } }
I20260812 02:42:27.655778 13494 leader_election.cc:288] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [CANDIDATE]: Term 1 election: Requested vote from peers 5d5ef850391a4908928fd407e151d4e4 (127.10.75.65:34739), 95544622803a4c4f9c312d20df24a4a6 (127.10.75.67:37963)
I20260812 02:42:27.656069 12858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6909b1df62448749260ebe8dc446fd6" candidate_uuid: "bf2e382677934e0d86e364ad941eca6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5ef850391a4908928fd407e151d4e4"
I20260812 02:42:27.656123 13354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6909b1df62448749260ebe8dc446fd6" candidate_uuid: "bf2e382677934e0d86e364ad941eca6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95544622803a4c4f9c312d20df24a4a6"
I20260812 02:42:27.656194 12858 raft_consensus.cc:3037] T a6909b1df62448749260ebe8dc446fd6 P 5d5ef850391a4908928fd407e151d4e4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:27.656242 13354 raft_consensus.cc:3037] T a6909b1df62448749260ebe8dc446fd6 P 95544622803a4c4f9c312d20df24a4a6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:27.657018 12858 raft_consensus.cc:2454] T a6909b1df62448749260ebe8dc446fd6 P 5d5ef850391a4908928fd407e151d4e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2e382677934e0d86e364ad941eca6e in term 1.
I20260812 02:42:27.657286 13354 raft_consensus.cc:2454] T a6909b1df62448749260ebe8dc446fd6 P 95544622803a4c4f9c312d20df24a4a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2e382677934e0d86e364ad941eca6e in term 1.
I20260812 02:42:27.657316 12980 leader_election.cc:302] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d5ef850391a4908928fd407e151d4e4, bf2e382677934e0d86e364ad941eca6e; no voters:
I20260812 02:42:27.657614 13494 raft_consensus.cc:2781] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:27.657747 13494 raft_consensus.cc:686] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [term 1 LEADER]: Becoming Leader. State: Replica: bf2e382677934e0d86e364ad941eca6e, State: Running, Role: LEADER
I20260812 02:42:27.657882 13494 consensus_queue.cc:237] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } }
I20260812 02:42:27.659409 12572 catalog_manager.cc:5495] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e reported cstate change: term changed from 0 to 1, leader changed from <none> to bf2e382677934e0d86e364ad941eca6e (127.10.75.66). New cstate: current_term: 1 leader_uuid: "bf2e382677934e0d86e364ad941eca6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } health_report { overall_health: UNKNOWN } } }
Aug 12 02:42:27 dist-test-slave-2p8l krb5kdc[12506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502546, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:27.709468 13534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.699865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:42743 (local address 127.0.0.1:53736)
0812 02:42:27.700223 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:27.700237 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:27.700337 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:27.700602 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:27.700604 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:27.700997 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:27.701101 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.701107 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.702141 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.702143 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.702683 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:27.702690 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.703294 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.703297 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:27.703366 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.703973 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:27.703985 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:27.705681 (+ 1696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:27.707602 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:27.707635 (+ 33us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:27.707644 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:27.707997 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:27.708348 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:27.708351 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:27.708352 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:27.708439 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:27.708839 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:27.708845 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:27.708994 (+ 149us) client_negotiation.cc:769] Sending connection context
0812 02:42:27.709123 (+ 129us) client_negotiation.cc:240] Negotiation successful
0812 02:42:27.709284 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":114,"threads_started":1}
I20260812 02:42:27.709515 12665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:27.699993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53736 (local address 127.10.75.126:42743)
0812 02:42:27.700147 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:27.700152 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:27.700307 (+ 155us) server_negotiation.cc:407] Connection header received
0812 02:42:27.700424 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:27.700427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:27.700475 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:27.700569 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:27.701211 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.701979 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.702817 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:27.703179 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:27.703285 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:27.705828 (+ 2543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:27.705832 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:27.705835 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:27.705861 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:27.707460 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:27.708118 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:27.708122 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:27.708124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:27.708240 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:27.708535 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:27.708538 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:27.708539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:27.708724 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:27.708804 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:27.709196 (+ 392us) server_negotiation.cc:299] Negotiation successful
0812 02:42:27.709401 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":49}
I20260812 02:42:27.713891 12572 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:53736:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 02:42:27.714818 12572 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:42:27.719975 13067 tablet_service.cc:1467] Processing CreateTablet for tablet 3edff1da2556412da345fe8878caa77b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0a639db7bf9042738a6f0191a0cf0371]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 02:42:27.719988 13321 tablet_service.cc:1467] Processing CreateTablet for tablet 3edff1da2556412da345fe8878caa77b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0a639db7bf9042738a6f0191a0cf0371]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 02:42:27.719962 12828 tablet_service.cc:1467] Processing CreateTablet for tablet 3edff1da2556412da345fe8878caa77b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0a639db7bf9042738a6f0191a0cf0371]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 02:42:27.720352 13067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3edff1da2556412da345fe8878caa77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:27.720352 13321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3edff1da2556412da345fe8878caa77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:27.720372 12828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3edff1da2556412da345fe8878caa77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:27.723196 13482 tablet_bootstrap.cc:492] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e: Bootstrap starting.
I20260812 02:42:27.723410 13483 tablet_bootstrap.cc:492] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4: Bootstrap starting.
I20260812 02:42:27.723846 13484 tablet_bootstrap.cc:492] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6: Bootstrap starting.
I20260812 02:42:27.724186 13482 tablet_bootstrap.cc:654] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:27.724474 13483 tablet_bootstrap.cc:654] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:27.724924 13484 tablet_bootstrap.cc:654] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:27.726039 13482 tablet_bootstrap.cc:492] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e: No bootstrap required, opened a new log
I20260812 02:42:27.726210 13482 ts_tablet_manager.cc:1397] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 02:42:27.726540 13484 tablet_bootstrap.cc:492] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6: No bootstrap required, opened a new log
I20260812 02:42:27.726620 13484 ts_tablet_manager.cc:1397] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 02:42:27.726696 13482 raft_consensus.cc:348] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } }
I20260812 02:42:27.726807 13482 raft_consensus.cc:374] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:27.726840 13482 raft_consensus.cc:729] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2e382677934e0d86e364ad941eca6e, State: Initialized, Role: FOLLOWER
I20260812 02:42:27.726958 13482 consensus_queue.cc:260] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } }
I20260812 02:42:27.727054 13484 raft_consensus.cc:348] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } }
I20260812 02:42:27.727175 13484 raft_consensus.cc:374] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:27.727209 13484 raft_consensus.cc:729] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95544622803a4c4f9c312d20df24a4a6, State: Initialized, Role: FOLLOWER
I20260812 02:42:27.727277 13482 ts_tablet_manager.cc:1428] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 02:42:27.727308 13494 tablet_replica.cc:439] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } } }
I20260812 02:42:27.727478 13494 tablet_replica.cc:442] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 02:42:27.727711 13484 consensus_queue.cc:260] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } }
I20260812 02:42:27.728037 13491 tablet_replica.cc:439] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } } }
I20260812 02:42:27.728183 13491 tablet_replica.cc:442] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 02:42:27.728454 13484 ts_tablet_manager.cc:1428] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 02:42:27.730409 13483 tablet_bootstrap.cc:492] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4: No bootstrap required, opened a new log
I20260812 02:42:27.730496 13483 ts_tablet_manager.cc:1397] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20260812 02:42:27.730955 13483 raft_consensus.cc:348] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } }
I20260812 02:42:27.731061 13483 raft_consensus.cc:374] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:27.731093 13483 raft_consensus.cc:729] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5ef850391a4908928fd407e151d4e4, State: Initialized, Role: FOLLOWER
I20260812 02:42:27.731221 13483 consensus_queue.cc:260] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } }
I20260812 02:42:27.731488 13483 ts_tablet_manager.cc:1428] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 02:42:27.731756 13490 tablet_replica.cc:439] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } } }
I20260812 02:42:27.731899 13490 tablet_replica.cc:442] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 02:42:27.862567 13187 tablet.cc:2369] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 02:42:27.874764 12934 tablet.cc:2369] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:42:28.007433 13491 raft_consensus.cc:482] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:42:28.007578 13491 raft_consensus.cc:504] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } }
I20260812 02:42:28.008672 13491 leader_election.cc:288] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d5ef850391a4908928fd407e151d4e4 (127.10.75.65:34739), bf2e382677934e0d86e364ad941eca6e (127.10.75.66:41735)
I20260812 02:42:28.012885 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:28.009042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:47623 (local address 127.10.75.65:34739)
0812 02:42:28.009183 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:28.009188 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:28.009510 (+ 322us) server_negotiation.cc:407] Connection header received
0812 02:42:28.009681 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:28.009684 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:28.009725 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:28.009810 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:28.010181 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.010723 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.011889 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.012288 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.012410 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:28.012462 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:28.012697 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 02:42:28.012762 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 02:42:28.012897 13475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:28.009070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:51203 (local address 127.10.75.66:41735)
0812 02:42:28.009245 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:28.009250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:28.009423 (+ 173us) server_negotiation.cc:407] Connection header received
0812 02:42:28.009602 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:28.009605 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:28.009652 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:28.009739 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:28.010031 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.010699 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.011889 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.012303 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.012430 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:28.012484 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:28.012715 (+ 231us) server_negotiation.cc:299] Negotiation successful
0812 02:42:28.012779 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 02:42:28.012920 13544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:28.008942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:34739 (local address 127.10.75.67:47623)
0812 02:42:28.009415 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:28.009427 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:28.009557 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:28.009822 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:28.009825 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:28.009841 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:28.009995 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:28.010003 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.010834 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.010839 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:28.011761 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:28.011770 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.012405 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.012408 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:28.012563 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:28.012583 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 02:42:28.012672 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 02:42:28.012747 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"mutex_wait_us":102,"thread_start_us":81,"threads_started":1}
I20260812 02:42:28.012926 13545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:28.008935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:41735 (local address 127.10.75.67:51203)
0812 02:42:28.009327 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:28.009340 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:28.009473 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:28.009752 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:28.009755 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:28.009771 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:28.009917 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:28.009923 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.010809 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.010815 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:28.011757 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:28.011766 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.012423 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.012427 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:28.012586 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:28.012603 (+ 17us) client_negotiation.cc:769] Sending connection context
0812 02:42:28.012697 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 02:42:28.012774 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"mutex_wait_us":99,"thread_start_us":76,"threads_started":1}
I20260812 02:42:28.013422 12858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3edff1da2556412da345fe8878caa77b" candidate_uuid: "95544622803a4c4f9c312d20df24a4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5ef850391a4908928fd407e151d4e4" is_pre_election: true
I20260812 02:42:28.013612 12858 raft_consensus.cc:2454] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95544622803a4c4f9c312d20df24a4a6 in term 0.
I20260812 02:42:28.013711 13099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3edff1da2556412da345fe8878caa77b" candidate_uuid: "95544622803a4c4f9c312d20df24a4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2e382677934e0d86e364ad941eca6e" is_pre_election: true
I20260812 02:42:28.013973 13099 raft_consensus.cc:2454] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95544622803a4c4f9c312d20df24a4a6 in term 0.
I20260812 02:42:28.014122 13229 leader_election.cc:302] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d5ef850391a4908928fd407e151d4e4, 95544622803a4c4f9c312d20df24a4a6; no voters:
I20260812 02:42:28.014396 13491 raft_consensus.cc:2781] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:42:28.014460 13491 raft_consensus.cc:482] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:42:28.014525 13491 raft_consensus.cc:3037] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:28.015657 13491 raft_consensus.cc:504] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } }
I20260812 02:42:28.016045 13491 leader_election.cc:288] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 [CANDIDATE]: Term 1 election: Requested vote from peers 5d5ef850391a4908928fd407e151d4e4 (127.10.75.65:34739), bf2e382677934e0d86e364ad941eca6e (127.10.75.66:41735)
I20260812 02:42:28.016461 12858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3edff1da2556412da345fe8878caa77b" candidate_uuid: "95544622803a4c4f9c312d20df24a4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5ef850391a4908928fd407e151d4e4"
I20260812 02:42:28.016594 12858 raft_consensus.cc:3037] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:28.016592 13099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3edff1da2556412da345fe8878caa77b" candidate_uuid: "95544622803a4c4f9c312d20df24a4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2e382677934e0d86e364ad941eca6e"
I20260812 02:42:28.016736 13099 raft_consensus.cc:3037] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:28.017531 12858 raft_consensus.cc:2454] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95544622803a4c4f9c312d20df24a4a6 in term 1.
I20260812 02:42:28.017827 13229 leader_election.cc:302] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d5ef850391a4908928fd407e151d4e4, 95544622803a4c4f9c312d20df24a4a6; no voters:
I20260812 02:42:28.017871 13099 raft_consensus.cc:2454] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95544622803a4c4f9c312d20df24a4a6 in term 1.
I20260812 02:42:28.018211 13491 raft_consensus.cc:2781] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:28.018437 13491 raft_consensus.cc:686] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 [term 1 LEADER]: Becoming Leader. State: Replica: 95544622803a4c4f9c312d20df24a4a6, State: Running, Role: LEADER
I20260812 02:42:28.018857 13491 consensus_queue.cc:237] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } }
I20260812 02:42:28.020148 13546 tablet_replica.cc:439] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6: TxnStatusTablet state changed. Reason: New leader 95544622803a4c4f9c312d20df24a4a6. Latest consensus state: current_term: 1 leader_uuid: "95544622803a4c4f9c312d20df24a4a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } } }
I20260812 02:42:28.020264 13546 tablet_replica.cc:442] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6: This TxnStatusTablet replica's current role is: LEADER
I20260812 02:42:28.020572 13550 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 02:42:28.020800 13550 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 02:42:28.021351 12571 catalog_manager.cc:5495] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95544622803a4c4f9c312d20df24a4a6 (127.10.75.67). New cstate: current_term: 1 leader_uuid: "95544622803a4c4f9c312d20df24a4a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } health_report { overall_health: HEALTHY } } }
I20260812 02:42:28.099754 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:28.095435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59886 (local address 127.10.75.67:37963)
0812 02:42:28.095701 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:28.095705 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:28.095720 (+ 15us) server_negotiation.cc:407] Connection header received
0812 02:42:28.095792 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:28.095794 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:28.095844 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:28.095941 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:42:28.096239 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.096839 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.098105 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.098360 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.098446 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:28.098831 (+ 385us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:42:28.099286 (+ 455us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:42:28.099389 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:28.099560 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 02:42:28.099618 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":131,"threads_started":1}
I20260812 02:42:28.099764 13534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:28.095302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:37963 (local address 127.0.0.1:59886)
0812 02:42:28.095554 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:28.095569 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:28.095674 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:28.095978 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:28.095981 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:28.095989 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 02:42:28.096114 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:28.096127 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.096948 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.096952 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:28.097947 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:28.097958 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.098472 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.098481 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:28.098587 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:28.098645 (+ 58us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 02:42:28.099408 (+ 763us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 02:42:28.099424 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 02:42:28.099503 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 02:42:28.099611 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150}
I20260812 02:42:28.103220 12858 raft_consensus.cc:1261] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4 [term 1 FOLLOWER]: Refusing update from remote peer 95544622803a4c4f9c312d20df24a4a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:42:28.103266 13099 raft_consensus.cc:1261] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e [term 1 FOLLOWER]: Refusing update from remote peer 95544622803a4c4f9c312d20df24a4a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:42:28.103708 13491 consensus_queue.cc:1035] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:28.104193 13546 consensus_queue.cc:1035] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:28.105765 13490 tablet_replica.cc:439] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4: TxnStatusTablet state changed. Reason: New leader 95544622803a4c4f9c312d20df24a4a6. Latest consensus state: current_term: 1 leader_uuid: "95544622803a4c4f9c312d20df24a4a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } } }
I20260812 02:42:28.105898 13490 tablet_replica.cc:442] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 02:42:28.106757 13494 tablet_replica.cc:439] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e: TxnStatusTablet state changed. Reason: New leader 95544622803a4c4f9c312d20df24a4a6. Latest consensus state: current_term: 1 leader_uuid: "95544622803a4c4f9c312d20df24a4a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } } }
I20260812 02:42:28.106879 13494 tablet_replica.cc:442] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 02:42:28.107964 13491 tablet_replica.cc:439] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "95544622803a4c4f9c312d20df24a4a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } } }
I20260812 02:42:28.107983 13494 consensus_queue.cc:1035] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:28.108069 13491 tablet_replica.cc:442] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6: This TxnStatusTablet replica's current role is: LEADER
I20260812 02:42:28.109009 13502 mvcc.cc:205] Tried to move back new op lower bound from 7317514437025046528 to 7317514436687409152. Current Snapshot: MvccSnapshot[applied={T|T < 7317514437025046528}]
I20260812 02:42:28.109766 13555 mvcc.cc:205] Tried to move back new op lower bound from 7317514437025046528 to 7317514436687409152. Current Snapshot: MvccSnapshot[applied={T|T < 7317514437025046528}]
I20260812 02:42:28.110970 13490 tablet_replica.cc:439] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "95544622803a4c4f9c312d20df24a4a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } } }
I20260812 02:42:28.111078 13490 tablet_replica.cc:442] T 3edff1da2556412da345fe8878caa77b P 5d5ef850391a4908928fd407e151d4e4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 02:42:28.112169 13546 tablet_replica.cc:439] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "95544622803a4c4f9c312d20df24a4a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } } }
I20260812 02:42:28.112298 13546 tablet_replica.cc:442] T 3edff1da2556412da345fe8878caa77b P 95544622803a4c4f9c312d20df24a4a6: This TxnStatusTablet replica's current role is: LEADER
I20260812 02:42:28.113147 13558 mvcc.cc:205] Tried to move back new op lower bound from 7317514437025046528 to 7317514436687409152. Current Snapshot: MvccSnapshot[applied={T|T < 7317514437025046528}]
I20260812 02:42:28.113309 13494 tablet_replica.cc:439] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "95544622803a4c4f9c312d20df24a4a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5ef850391a4908928fd407e151d4e4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34739 } } peers { permanent_uuid: "bf2e382677934e0d86e364ad941eca6e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41735 } } peers { permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 } } }
I20260812 02:42:28.113425 13494 tablet_replica.cc:442] T 3edff1da2556412da345fe8878caa77b P bf2e382677934e0d86e364ad941eca6e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 02:42:28.117995 13489 consensus_queue.cc:1035] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "95544622803a4c4f9c312d20df24a4a6" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:28.141927 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:28.138136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:57477 (local address 127.10.75.67:37963)
0812 02:42:28.138266 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:28.138273 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:28.138395 (+ 122us) server_negotiation.cc:407] Connection header received
0812 02:42:28.138600 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:28.138603 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:28.138680 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:28.138741 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:42:28.139043 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.139643 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.140874 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.141084 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.141163 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:28.141529 (+ 366us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:42:28.141592 (+ 63us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:42:28.141646 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:28.141791 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 02:42:28.141831 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 02:42:28.142001 13578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:28.137963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:37963 (local address 127.10.75.66:57477)
0812 02:42:28.138302 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:28.138318 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:28.138433 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:28.138791 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:28.138795 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:28.138804 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 02:42:28.138925 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:28.138933 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.139783 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.139787 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:28.140720 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:28.140732 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.141213 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.141217 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:28.141301 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:28.141366 (+ 65us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 02:42:28.141688 (+ 322us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 02:42:28.141696 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 02:42:28.141774 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 02:42:28.141861 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":134,"threads_started":1}
I20260812 02:42:28.167927 13475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:28.163807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:52893 (local address 127.10.75.66:41735)
0812 02:42:28.163906 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:28.163910 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:28.164133 (+ 223us) server_negotiation.cc:407] Connection header received
0812 02:42:28.164216 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:28.164219 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:28.164265 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:28.164347 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:42:28.164688 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.165484 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.166765 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.167004 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.167128 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:28.167466 (+ 338us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:42:28.167545 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:42:28.167629 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:28.167729 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 02:42:28.167781 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 02:42:28.167945 13581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:28.163765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:41735 (local address 127.10.75.67:52893)
0812 02:42:28.164040 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:28.164057 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:28.164149 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:28.164396 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:28.164398 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:28.164405 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 02:42:28.164568 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:28.164573 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.165633 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.165636 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:28.166621 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:28.166631 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.167143 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.167146 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:28.167241 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:28.167297 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 02:42:28.167637 (+ 340us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 02:42:28.167647 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 02:42:28.167719 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 02:42:28.167798 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":98,"threads_started":1}
I20260812 02:42:28.193359 12571 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:42:28.193555 12571 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:42:28.195446 12571 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 15e1bd530afc4a7f95c6dbb943b71694: Sending DeleteTablet for 3 replicas of tablet a6909b1df62448749260ebe8dc446fd6
I20260812 02:42:28.196046 13067 tablet_service.cc:1514] Processing DeleteTablet for tablet a6909b1df62448749260ebe8dc446fd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:28 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:59642
I20260812 02:42:28.196071 13321 tablet_service.cc:1514] Processing DeleteTablet for tablet a6909b1df62448749260ebe8dc446fd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:28 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:59884
I20260812 02:42:28.196097 12828 tablet_service.cc:1514] Processing DeleteTablet for tablet a6909b1df62448749260ebe8dc446fd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:28 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:56490
I20260812 02:42:28.196435 13585 tablet_replica.cc:330] T a6909b1df62448749260ebe8dc446fd6 P 95544622803a4c4f9c312d20df24a4a6: stopping tablet replica
I20260812 02:42:28.196581 13585 raft_consensus.cc:2229] T a6909b1df62448749260ebe8dc446fd6 P 95544622803a4c4f9c312d20df24a4a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:42:28.196723 13585 raft_consensus.cc:2258] T a6909b1df62448749260ebe8dc446fd6 P 95544622803a4c4f9c312d20df24a4a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:28.196959 13586 tablet_replica.cc:330] T a6909b1df62448749260ebe8dc446fd6 P 5d5ef850391a4908928fd407e151d4e4: stopping tablet replica
I20260812 02:42:28.197093 13586 raft_consensus.cc:2229] T a6909b1df62448749260ebe8dc446fd6 P 5d5ef850391a4908928fd407e151d4e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:42:28.197216 13586 raft_consensus.cc:2258] T a6909b1df62448749260ebe8dc446fd6 P 5d5ef850391a4908928fd407e151d4e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:28.197386 13584 tablet_replica.cc:330] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e: stopping tablet replica
I20260812 02:42:28.197518 13584 raft_consensus.cc:2229] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:42:28.197698 13584 raft_consensus.cc:2258] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:28.197705 13585 ts_tablet_manager.cc:1905] T a6909b1df62448749260ebe8dc446fd6 P 95544622803a4c4f9c312d20df24a4a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:28.197866 13586 ts_tablet_manager.cc:1905] T a6909b1df62448749260ebe8dc446fd6 P 5d5ef850391a4908928fd407e151d4e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:28.198356 13584 ts_tablet_manager.cc:1905] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:28.200771 13586 ts_tablet_manager.cc:1918] T a6909b1df62448749260ebe8dc446fd6 P 5d5ef850391a4908928fd407e151d4e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 02:42:28.200771 13585 ts_tablet_manager.cc:1918] T a6909b1df62448749260ebe8dc446fd6 P 95544622803a4c4f9c312d20df24a4a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 02:42:28.200860 13585 log.cc:1196] T a6909b1df62448749260ebe8dc446fd6 P 95544622803a4c4f9c312d20df24a4a6: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/a6909b1df62448749260ebe8dc446fd6
I20260812 02:42:28.200860 13586 log.cc:1196] T a6909b1df62448749260ebe8dc446fd6 P 5d5ef850391a4908928fd407e151d4e4: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-0/wal/wals/a6909b1df62448749260ebe8dc446fd6
I20260812 02:42:28.201138 13586 ts_tablet_manager.cc:1939] T a6909b1df62448749260ebe8dc446fd6 P 5d5ef850391a4908928fd407e151d4e4: Deleting consensus metadata
I20260812 02:42:28.201148 13585 ts_tablet_manager.cc:1939] T a6909b1df62448749260ebe8dc446fd6 P 95544622803a4c4f9c312d20df24a4a6: Deleting consensus metadata
I20260812 02:42:28.201385 13584 ts_tablet_manager.cc:1918] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 02:42:28.201467 13584 log.cc:1196] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/a6909b1df62448749260ebe8dc446fd6
I20260812 02:42:28.201763 13584 ts_tablet_manager.cc:1939] T a6909b1df62448749260ebe8dc446fd6 P bf2e382677934e0d86e364ad941eca6e: Deleting consensus metadata
I20260812 02:42:28.201789 12553 catalog_manager.cc:4841] TS 5d5ef850391a4908928fd407e151d4e4 (127.10.75.65:34739): tablet a6909b1df62448749260ebe8dc446fd6 (table test-table [id=edad5d1b182842dc9bff5749b504d104]) successfully deleted
I20260812 02:42:28.201789 12551 catalog_manager.cc:4841] TS 95544622803a4c4f9c312d20df24a4a6 (127.10.75.67:37963): tablet a6909b1df62448749260ebe8dc446fd6 (table test-table [id=edad5d1b182842dc9bff5749b504d104]) successfully deleted
I20260812 02:42:28.203074 12555 catalog_manager.cc:4841] TS bf2e382677934e0d86e364ad941eca6e (127.10.75.66:41735): tablet a6909b1df62448749260ebe8dc446fd6 (table test-table [id=edad5d1b182842dc9bff5749b504d104]) successfully deleted
Aug 12 02:42:28 dist-test-slave-2p8l krb5kdc[12506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502547, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.75.65@KRBTEST.COM
I20260812 02:42:28.208190 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:28.197562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56504 (local address 127.10.75.65:34739)
0812 02:42:28.197668 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:28.197673 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:28.198387 (+ 714us) server_negotiation.cc:407] Connection header received
0812 02:42:28.198649 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:28.198653 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:28.198703 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:28.198757 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:28.199740 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.200495 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.202087 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.202317 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.202405 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:28.205047 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:28.205056 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:28.205070 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:28.205091 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:28.206620 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:28.207017 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:28.207023 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:28.207024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:28.207100 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:28.207344 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:28.207346 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:28.207347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:28.207574 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:28.207733 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:28.207883 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 02:42:28.207977 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260812 02:42:28.208736 12907 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56504
I20260812 02:42:28.217468 13592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:28.210509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53740 (local address 127.10.75.126:42743)
0812 02:42:28.210753 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:28.210757 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:28.210800 (+ 43us) server_negotiation.cc:407] Connection header received
0812 02:42:28.210943 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:28.210945 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:28.210985 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:28.211057 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:28.211601 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.212094 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.212805 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:28.213013 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:28.213088 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:28.214574 (+ 1486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:28.214577 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:28.214579 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:28.214598 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:28.216123 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:28.216483 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:28.216485 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:28.216486 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:28.216562 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:28.216815 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:28.216817 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:28.216818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:28.216971 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:28.217069 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:28.217259 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 02:42:28.217351 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":88,"threads_started":1}
W20260812 02:42:28.217828 12571 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53740
I20260812 02:42:28.218886 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 12709
I20260812 02:42:28.234297 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 12949
I20260812 02:42:28.245927 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 13200
I20260812 02:42:28.260509 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 12525
2026-08-12T02:42:28Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3322 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:42:28 dist-test-slave-2p8l krb5kdc[13597](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:42:28 dist-test-slave-2p8l krb5kdc[13597](info): set up 2 sockets
Aug 12 02:42:28 dist-test-slave-2p8l krb5kdc[13597](info): commencing operation
krb5kdc: starting...
W20260812 02:42:29.578931 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:42:29 dist-test-slave-2p8l krb5kdc[13597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:42:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:42:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:42:29.703112 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:35325
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:34107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:35325
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:29.814604 13626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:29.814884 13626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:29.814952 13626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:29.818905 13626 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:42:29.818976 13626 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 02:42:29.819011 13626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:29.819074 13626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:29.819113 13626 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:42:29.819157 13626 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:42:29.824208 13626 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:34107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:35325
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:35325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13626
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:29.825246 13626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:29.826284 13626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:29.834715 13635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:29.834762 13638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:29.834882 13626 server_base.cc:1034] running on GCE node
W20260812 02:42:29.835040 13643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:29.835558 13626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:29.836584 13626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:29.837772 13626 hybrid_clock.cc:648] HybridClock initialized: now 1786502549837752 us; error 41 us; skew 500 ppm
Aug 12 02:42:29 dist-test-slave-2p8l krb5kdc[13597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502549, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:29.846617 13626 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:42:29.847488 13626 webserver.cc:460] Webserver started at http://127.10.75.126:34617/ using document root <none> and password file <none>
I20260812 02:42:29.847982 13626 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:29.848042 13626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:29.848206 13626 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:29.850243 13626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "0c0302d24d654f018a3c27c6876fff54"
format_stamp: "Formatted at 2026-08-12 02:42:29 on dist-test-slave-2p8l"
server_key: "34216aa61dcc6ef4b192b0def4d52772"
server_key_iv: "06a481a8682352925a0f6d2a12cc59f3"
server_key_version: "encryptionkey@0"
I20260812 02:42:29.850752 13626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "0c0302d24d654f018a3c27c6876fff54"
format_stamp: "Formatted at 2026-08-12 02:42:29 on dist-test-slave-2p8l"
server_key: "34216aa61dcc6ef4b192b0def4d52772"
server_key_iv: "06a481a8682352925a0f6d2a12cc59f3"
server_key_version: "encryptionkey@0"
I20260812 02:42:29.854319 13626 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:42:29.856945 13654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:29.858316 13626 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:29.858422 13626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "0c0302d24d654f018a3c27c6876fff54"
format_stamp: "Formatted at 2026-08-12 02:42:29 on dist-test-slave-2p8l"
server_key: "34216aa61dcc6ef4b192b0def4d52772"
server_key_iv: "06a481a8682352925a0f6d2a12cc59f3"
server_key_version: "encryptionkey@0"
I20260812 02:42:29.858532 13626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:29.887393 13626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:29.890373 13626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:29.890542 13626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:29.898907 13626 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:35325
I20260812 02:42:29.898939 13774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:35325 every 8 connection(s)
I20260812 02:42:29.899919 13626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:42:29.902594 13775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:29.907939 13775 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54: Bootstrap starting.
I20260812 02:42:29.909566 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 13626
I20260812 02:42:29.909657 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:42:29.909927 10541 external_mini_cluster.cc:1428] Setting key 1e0b408c37e644de9bb89af4deff0d58
I20260812 02:42:29.910486 13775 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:29.911321 13775 log.cc:824] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:29.913498 13775 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54: No bootstrap required, opened a new log
I20260812 02:42:29.917711 13775 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c0302d24d654f018a3c27c6876fff54" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35325 } }
I20260812 02:42:29.917979 13775 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:29.918094 13775 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0302d24d654f018a3c27c6876fff54, State: Initialized, Role: FOLLOWER
I20260812 02:42:29.918556 13775 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c0302d24d654f018a3c27c6876fff54" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35325 } }
I20260812 02:42:29.918687 13775 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:42:29.918776 13775 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:42:29.918879 13775 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54 [term 0 FOLLOWER]: Advancing to term 1
Aug 12 02:42:29 dist-test-slave-2p8l krb5kdc[13597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:29.920055 13775 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c0302d24d654f018a3c27c6876fff54" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35325 } }
I20260812 02:42:29.920408 13775 leader_election.cc:302] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c0302d24d654f018a3c27c6876fff54; no voters:
I20260812 02:42:29.920733 13775 leader_election.cc:288] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:42:29.920902 13785 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:29.921165 13785 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0302d24d654f018a3c27c6876fff54, State: Running, Role: LEADER
I20260812 02:42:29.921638 13785 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c0302d24d654f018a3c27c6876fff54" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35325 } }
I20260812 02:42:29.922099 13775 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:42:29.923708 13787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c0302d24d654f018a3c27c6876fff54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c0302d24d654f018a3c27c6876fff54" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35325 } } }
I20260812 02:42:29.923837 13787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:29.925154 13786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c0302d24d654f018a3c27c6876fff54. Latest consensus state: current_term: 1 leader_uuid: "0c0302d24d654f018a3c27c6876fff54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c0302d24d654f018a3c27c6876fff54" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35325 } } }
I20260812 02:42:29.925251 13786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:29.926318 13782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:29.911099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37048 (local address 127.10.75.126:35325)
0812 02:42:29.911566 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:29.911584 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:29.911626 (+ 42us) server_negotiation.cc:407] Connection header received
0812 02:42:29.912461 (+ 835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:29.912483 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:29.912881 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:29.913253 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:29.914028 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:29.915632 (+ 1604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:29.916493 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:29.917269 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:29.917428 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:29.920330 (+ 2902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:29.920335 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:29.920347 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:29.920374 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:29.922691 (+ 2317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:29.923259 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:29.923267 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:29.923275 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:29.923423 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:29.923768 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:29.923773 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:29.923775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:29.924328 (+ 553us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:29.924535 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:29.925260 (+ 725us) server_negotiation.cc:299] Negotiation successful
0812 02:42:29.925547 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":142,"threads_started":1}
W20260812 02:42:29.927672 13807 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:42:29.927757 13807 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:42:29.927820 13803 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:42:29.928512 13803 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:42:29.933736 13803 catalog_manager.cc:1347] Generated new cluster ID: 49fc969098a74ba196e83c3ba90e44ff
I20260812 02:42:29.933804 13803 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:42:29.961311 13803 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:42:29.962718 13803 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:42:29.968461 13803 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54: Generated new TSK 0
I20260812 02:42:29.969113 13803 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
I20260812 02:42:30.005276 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35325
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:34107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:30.116204 13820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:30.116444 13820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:30.116490 13820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:30.120937 13820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:30.120988 13820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:30.121027 13820 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 02:42:30.121042 13820 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 02:42:30.121073 13820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:42:30.126442 13820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:34107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.75.126:35325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:30.127346 13820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:30.128274 13820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:30.137514 13833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:30.137550 13830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:30.137513 13829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:30.137727 13820 server_base.cc:1034] running on GCE node
I20260812 02:42:30.138298 13820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:30.138962 13820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:30.140151 13820 hybrid_clock.cc:648] HybridClock initialized: now 1786502550140142 us; error 32 us; skew 500 ppm
Aug 12 02:42:30 dist-test-slave-2p8l krb5kdc[13597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502550, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:30.143198 13820 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:42:30.144022 13820 webserver.cc:460] Webserver started at http://127.10.75.65:46825/ using document root <none> and password file <none>
I20260812 02:42:30.144582 13820 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:30.144683 13820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:30.144917 13820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:30.146957 13820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "1910b15781e5457487271de682c8fa5d"
format_stamp: "Formatted at 2026-08-12 02:42:30 on dist-test-slave-2p8l"
server_key: "14959bc27e74f3f709f9a18f76bc6305"
server_key_iv: "894f0e80acb2d8cb0400889c81902682"
server_key_version: "encryptionkey@0"
I20260812 02:42:30.147524 13820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "1910b15781e5457487271de682c8fa5d"
format_stamp: "Formatted at 2026-08-12 02:42:30 on dist-test-slave-2p8l"
server_key: "14959bc27e74f3f709f9a18f76bc6305"
server_key_iv: "894f0e80acb2d8cb0400889c81902682"
server_key_version: "encryptionkey@0"
I20260812 02:42:30.151160 13820 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260812 02:42:30.153469 13846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:30.154712 13820 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 02:42:30.154847 13820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "1910b15781e5457487271de682c8fa5d"
format_stamp: "Formatted at 2026-08-12 02:42:30 on dist-test-slave-2p8l"
server_key: "14959bc27e74f3f709f9a18f76bc6305"
server_key_iv: "894f0e80acb2d8cb0400889c81902682"
server_key_version: "encryptionkey@0"
I20260812 02:42:30.154958 13820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:30.169255 13820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:30.172494 13820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:30.172712 13820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:30.174129 13820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:30.174207 13820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:30.174276 13820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:30.174328 13820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 02:42:30 dist-test-slave-2p8l krb5kdc[13597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502550, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:30.185653 13820 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:37993
I20260812 02:42:30.185743 14038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:37993 every 8 connection(s)
I20260812 02:42:30.186619 13820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:42:30.188632 13782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.175037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:35995 (local address 127.10.75.126:35325)
0812 02:42:30.175174 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:30.175178 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:30.176207 (+ 1029us) server_negotiation.cc:407] Connection header received
0812 02:42:30.177323 (+ 1116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:30.177327 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:30.177396 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:30.177457 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:30.179121 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.179716 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.181287 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.181633 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.181760 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.184773 (+ 3013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:30.184777 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:30.184780 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:30.184812 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:30.186469 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:30.187028 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:30.187032 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:30.187034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:30.187154 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:30.187541 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:30.187545 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:30.187547 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:30.187739 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:30.187848 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:30.188315 (+ 467us) server_negotiation.cc:299] Negotiation successful
0812 02:42:30.188450 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 02:42:30.189363 13861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.175565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35325 (local address 127.10.75.65:35995)
0812 02:42:30.176050 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:30.176091 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:30.177046 (+ 955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:30.177897 (+ 851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:30.177907 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:30.178339 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:30.178964 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.178980 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.179855 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.179859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.181155 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.181166 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.181810 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.181814 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.181985 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.182705 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:30.182725 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:30.184586 (+ 1861us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:30.186596 (+ 2010us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:30.186602 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:30.186615 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:30.186917 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:30.187267 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:30.187269 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:30.187271 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:30.187429 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:30.187848 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:30.187855 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:30.188082 (+ 227us) client_negotiation.cc:769] Sending connection context
0812 02:42:30.188268 (+ 186us) client_negotiation.cc:240] Negotiation successful
0812 02:42:30.188556 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":153,"threads_started":1}
I20260812 02:42:30.190543 14039 heartbeater.cc:347] Connected to a master server at 127.10.75.126:35325
I20260812 02:42:30.190771 14039 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:30.191247 14039 heartbeater.cc:511] Master 127.10.75.126:35325 requested a full tablet report, sending...
I20260812 02:42:30.191829 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 13820
I20260812 02:42:30.191958 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:42:30.192266 10541 external_mini_cluster.cc:1428] Setting key 3ebfb1e8545ed9dd23d38ba55c96492f
I20260812 02:42:30.192946 13686 ts_manager.cc:194] Registered new tserver with Master: 1910b15781e5457487271de682c8fa5d (127.10.75.65:37993)
I20260812 02:42:30.194314 13686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:35995
I20260812 02:42:30.202373 14049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.193129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35325 (local address 127.10.75.65:45841)
0812 02:42:30.193475 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:30.193488 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:30.193598 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:30.195849 (+ 2251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:30.195851 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:30.196009 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:30.196099 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.196104 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.196852 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.196855 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.197441 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.197452 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.197936 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.197940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.198033 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.198553 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:30.198573 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:30.198950 (+ 377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:30.200868 (+ 1918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:30.200870 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:30.200872 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:30.201089 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:30.201396 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:30.201399 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:30.201400 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:30.201475 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:30.201910 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:30.201912 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:30.201984 (+ 72us) client_negotiation.cc:769] Sending connection context
0812 02:42:30.202118 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 02:42:30.202236 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":132,"threads_started":1}
I20260812 02:42:30.202494 13782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.193071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:45841 (local address 127.10.75.126:35325)
0812 02:42:30.193179 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:30.193183 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:30.193558 (+ 375us) server_negotiation.cc:407] Connection header received
0812 02:42:30.193713 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:30.193716 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:30.193761 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:30.193822 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:30.196215 (+ 2393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.196710 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.197577 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.197809 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.197931 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.199079 (+ 1148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:30.199083 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:30.199086 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:30.199108 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:30.200749 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:30.201198 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:30.201204 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:30.201206 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:30.201299 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:30.201570 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:30.201574 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:30.201576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:30.201807 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:30.201922 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:30.202179 (+ 257us) server_negotiation.cc:299] Negotiation successful
0812 02:42:30.202306 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
WARNING: no policy specified for kudu/127.10.75.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
I20260812 02:42:30.221629 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35325
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:34107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:30.331219 14053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:30.331497 14053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:30.331581 14053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:30.335750 14053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:30.335839 14053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:30.335909 14053 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 02:42:30.335950 14053 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 02:42:30.336016 14053 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:42:30.341143 14053 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:34107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.75.126:35325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:30.342237 14053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:30.343344 14053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:30.352790 14060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:30.352799 14064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:30.352800 14062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:30.353586 14053 server_base.cc:1034] running on GCE node
I20260812 02:42:30.354000 14053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:30.354681 14053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:30.355863 14053 hybrid_clock.cc:648] HybridClock initialized: now 1786502550355829 us; error 48 us; skew 500 ppm
Aug 12 02:42:30 dist-test-slave-2p8l krb5kdc[13597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502550, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:30.358747 14053 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:42:30.359560 14053 webserver.cc:460] Webserver started at http://127.10.75.66:39411/ using document root <none> and password file <none>
I20260812 02:42:30.360116 14053 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:30.360181 14053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:30.360433 14053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:30.362515 14053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "3837eed94d364463a8c1612e8f184a29"
format_stamp: "Formatted at 2026-08-12 02:42:30 on dist-test-slave-2p8l"
server_key: "e1fbfef91a39d8da366f6fbc381c822a"
server_key_iv: "1cc40b40e7e71595d851e563c4d0d062"
server_key_version: "encryptionkey@0"
I20260812 02:42:30.363129 14053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "3837eed94d364463a8c1612e8f184a29"
format_stamp: "Formatted at 2026-08-12 02:42:30 on dist-test-slave-2p8l"
server_key: "e1fbfef91a39d8da366f6fbc381c822a"
server_key_iv: "1cc40b40e7e71595d851e563c4d0d062"
server_key_version: "encryptionkey@0"
I20260812 02:42:30.366783 14053 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 02:42:30.369141 14074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:30.370381 14053 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:30.370514 14053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "3837eed94d364463a8c1612e8f184a29"
format_stamp: "Formatted at 2026-08-12 02:42:30 on dist-test-slave-2p8l"
server_key: "e1fbfef91a39d8da366f6fbc381c822a"
server_key_iv: "1cc40b40e7e71595d851e563c4d0d062"
server_key_version: "encryptionkey@0"
I20260812 02:42:30.370626 14053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:30.389678 14053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:30.392855 14053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:30.393046 14053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:30.394552 14053 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:30.394604 14053 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:30.394644 14053 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:30.394742 14053 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 02:42:30 dist-test-slave-2p8l krb5kdc[13597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502550, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:30.406011 14053 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:46781
I20260812 02:42:30.406148 14269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:46781 every 8 connection(s)
I20260812 02:42:30.406936 14053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:42:30.408172 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 14053
I20260812 02:42:30.408265 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:42:30.408547 10541 external_mini_cluster.cc:1428] Setting key cbd1d4d33013f2f01c4545961236a800
I20260812 02:42:30.408725 13782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.395349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:54487 (local address 127.10.75.126:35325)
0812 02:42:30.395541 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:30.395546 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:30.396342 (+ 796us) server_negotiation.cc:407] Connection header received
0812 02:42:30.397305 (+ 963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:30.397310 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:30.397376 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:30.397481 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:30.398940 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.399535 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.400718 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.401102 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.401217 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.404846 (+ 3629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:30.404852 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:30.404854 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:30.404885 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:30.406557 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:30.407069 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:30.407076 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:30.407078 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:30.407164 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:30.407570 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:30.407573 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:30.407575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:30.407808 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:30.407890 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:30.408413 (+ 523us) server_negotiation.cc:299] Negotiation successful
0812 02:42:30.408538 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 02:42:30.409623 14090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.395714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35325 (local address 127.10.75.66:54487)
0812 02:42:30.396163 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:30.396213 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:30.397047 (+ 834us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:30.397787 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:30.397815 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:30.398329 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:30.398789 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.398802 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.399674 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.399677 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.400585 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.400595 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.401362 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.401365 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.401558 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.402325 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:30.402370 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:30.404673 (+ 2303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:30.406687 (+ 2014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:30.406693 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:30.406706 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:30.406961 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:30.407260 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:30.407264 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:30.407266 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:30.407449 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:30.407918 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:30.407923 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:30.408139 (+ 216us) client_negotiation.cc:769] Sending connection context
0812 02:42:30.408351 (+ 212us) client_negotiation.cc:240] Negotiation successful
0812 02:42:30.408655 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":126,"threads_started":1}
I20260812 02:42:30.412581 14270 heartbeater.cc:347] Connected to a master server at 127.10.75.126:35325
I20260812 02:42:30.412711 14270 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:30.413332 14270 heartbeater.cc:511] Master 127.10.75.126:35325 requested a full tablet report, sending...
I20260812 02:42:30.414350 13687 ts_manager.cc:194] Registered new tserver with Master: 3837eed94d364463a8c1612e8f184a29 (127.10.75.66:46781)
I20260812 02:42:30.414978 13687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:54487
WARNING: no policy specified for kudu/127.10.75.67@KRBTEST.COM; defaulting to no policy
I20260812 02:42:30.421132 14287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.412781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35325 (local address 127.10.75.66:48183)
0812 02:42:30.413174 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:30.413191 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:30.413298 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:30.413561 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:30.413565 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:30.413773 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:30.413867 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.413872 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.414966 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.414970 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.415922 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.415933 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.416636 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.416639 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.416736 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.417295 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:30.417312 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:30.417646 (+ 334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:30.419617 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:30.419620 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:30.419621 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:30.419816 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:30.420123 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:30.420125 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:30.420126 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:30.420199 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:30.420735 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:30.420738 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:30.420814 (+ 76us) client_negotiation.cc:769] Sending connection context
0812 02:42:30.420902 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 02:42:30.421003 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":85,"threads_started":1}
I20260812 02:42:30.421180 13782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.412823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:48183 (local address 127.10.75.126:35325)
0812 02:42:30.412923 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:30.412927 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:30.413280 (+ 353us) server_negotiation.cc:407] Connection header received
0812 02:42:30.413390 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:30.413393 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:30.413436 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:30.413522 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:30.413988 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.414820 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.416052 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.416475 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.416623 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.417806 (+ 1183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:30.417811 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:30.417815 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:30.417843 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:30.419501 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:30.419926 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:30.419931 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:30.419934 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:30.420022 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:30.420296 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:30.420301 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:30.420304 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:30.420621 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:30.420729 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:30.420968 (+ 239us) server_negotiation.cc:299] Negotiation successful
0812 02:42:30.421060 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
I20260812 02:42:30.439323 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35325
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:34107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:30.552163 14289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:30.552398 14289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:30.552469 14289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:30.556458 14289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:30.556517 14289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:30.556589 14289 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 02:42:30.556632 14289 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 02:42:30.556701 14289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:42:30.561954 14289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:34107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.75.126:35325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:30.562989 14289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:30.564015 14289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:30.573633 14302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:30.573745 14289 server_base.cc:1034] running on GCE node
W20260812 02:42:30.573658 14310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:30.573630 14304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:30.574373 14289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:30.575071 14289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:30.576236 14289 hybrid_clock.cc:648] HybridClock initialized: now 1786502550576223 us; error 26 us; skew 500 ppm
Aug 12 02:42:30 dist-test-slave-2p8l krb5kdc[13597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502550, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:30.578980 14289 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:42:30.579859 14289 webserver.cc:460] Webserver started at http://127.10.75.67:41665/ using document root <none> and password file <none>
I20260812 02:42:30.580415 14289 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:30.580475 14289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:30.580710 14289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:30.582785 14289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "35216454ca59473da0299411c3b1e6e2"
format_stamp: "Formatted at 2026-08-12 02:42:30 on dist-test-slave-2p8l"
server_key: "4038f6de114bf90d6a14621d11e81888"
server_key_iv: "fd5a7a29525cf0de3ee4c230a0bd8b5d"
server_key_version: "encryptionkey@0"
I20260812 02:42:30.583352 14289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "35216454ca59473da0299411c3b1e6e2"
format_stamp: "Formatted at 2026-08-12 02:42:30 on dist-test-slave-2p8l"
server_key: "4038f6de114bf90d6a14621d11e81888"
server_key_iv: "fd5a7a29525cf0de3ee4c230a0bd8b5d"
server_key_version: "encryptionkey@0"
I20260812 02:42:30.587105 14289 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 02:42:30.589510 14322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:30.590760 14289 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:30.590917 14289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "35216454ca59473da0299411c3b1e6e2"
format_stamp: "Formatted at 2026-08-12 02:42:30 on dist-test-slave-2p8l"
server_key: "4038f6de114bf90d6a14621d11e81888"
server_key_iv: "fd5a7a29525cf0de3ee4c230a0bd8b5d"
server_key_version: "encryptionkey@0"
I20260812 02:42:30.591043 14289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:30.619879 14289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:30.623227 14289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:30.623404 14289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:30.625126 14289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:30.625206 14289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:30.625250 14289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:30.625309 14289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 02:42:30 dist-test-slave-2p8l krb5kdc[13597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502550, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:30.636983 14289 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:39331
I20260812 02:42:30.637115 14526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:39331 every 8 connection(s)
I20260812 02:42:30.638173 14289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:42:30.640954 13782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.625864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:59101 (local address 127.10.75.126:35325)
0812 02:42:30.626044 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:30.626049 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:30.627389 (+ 1340us) server_negotiation.cc:407] Connection header received
0812 02:42:30.628663 (+ 1274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:30.628666 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:30.628726 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:30.628818 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:30.630606 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.631489 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.633518 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.633728 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.633811 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.637061 (+ 3250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:30.637065 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:30.637068 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:30.637096 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:30.638984 (+ 1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:30.639527 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:30.639531 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:30.639538 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:30.639646 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:30.639958 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:30.639960 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:30.639961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:30.640150 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:30.640232 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:30.640696 (+ 464us) server_negotiation.cc:299] Negotiation successful
0812 02:42:30.640811 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 02:42:30.641672 14335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.626746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35325 (local address 127.10.75.67:59101)
0812 02:42:30.627216 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:30.627268 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:30.628427 (+ 1159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:30.629042 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:30.629054 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:30.629596 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:30.630414 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.630438 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.631665 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.631671 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.633364 (+ 1693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.633381 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.633903 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.633909 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.634181 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.634902 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:30.634928 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:30.636870 (+ 1942us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:30.639101 (+ 2231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:30.639110 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:30.639125 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:30.639417 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:30.639731 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:30.639734 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:30.639735 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:30.639861 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:30.640241 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:30.640245 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:30.640451 (+ 206us) client_negotiation.cc:769] Sending connection context
0812 02:42:30.640593 (+ 142us) client_negotiation.cc:240] Negotiation successful
0812 02:42:30.640834 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":146,"threads_started":1}
I20260812 02:42:30.642935 14527 heartbeater.cc:347] Connected to a master server at 127.10.75.126:35325
I20260812 02:42:30.643095 14527 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:30.643632 14527 heartbeater.cc:511] Master 127.10.75.126:35325 requested a full tablet report, sending...
I20260812 02:42:30.644766 13686 ts_manager.cc:194] Registered new tserver with Master: 35216454ca59473da0299411c3b1e6e2 (127.10.75.67:39331)
I20260812 02:42:30.645624 13686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:59101
I20260812 02:42:30.645826 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 14289
I20260812 02:42:30.645946 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:42:30.646320 10541 external_mini_cluster.cc:1428] Setting key 6a12dcf43b61d327403e48373bc232a2
I20260812 02:42:30.649129 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:42:30.653504 14539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.645262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35325 (local address 127.10.75.67:60527)
0812 02:42:30.645582 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:30.645597 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:30.645753 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:30.646160 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:30.646163 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:30.646399 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:30.646524 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.646531 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.647600 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.647602 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.648432 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.648461 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.648902 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.648905 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.648994 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.649494 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:30.649508 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:30.649916 (+ 408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:30.651892 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:30.651895 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:30.651896 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:30.652078 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:30.652389 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:30.652391 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:30.652392 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:30.652464 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:30.653017 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:30.653020 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:30.653138 (+ 118us) client_negotiation.cc:769] Sending connection context
0812 02:42:30.653250 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 02:42:30.653357 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":93,"threads_started":1}
I20260812 02:42:30.653689 13782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.645349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:60527 (local address 127.10.75.126:35325)
0812 02:42:30.645462 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:30.645465 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:30.645679 (+ 214us) server_negotiation.cc:407] Connection header received
0812 02:42:30.645867 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:30.645873 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:30.645929 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:30.646006 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:30.646658 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.647464 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.648556 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.648784 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.648895 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.650053 (+ 1158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:30.650056 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:30.650096 (+ 40us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:30.650125 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:30.651775 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:30.652193 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:30.652198 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:30.652200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:30.652296 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:30.652552 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:30.652555 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:30.652556 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:30.652905 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:30.653018 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:30.653341 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 02:42:30.653489 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
Aug 12 02:42:30 dist-test-slave-2p8l krb5kdc[13597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502550, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 02:42:30 dist-test-slave-2p8l krb5kdc[13597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502550, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:30.677944 13782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.669820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37062 (local address 127.10.75.126:35325)
0812 02:42:30.669959 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:30.669963 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:30.669977 (+ 14us) server_negotiation.cc:407] Connection header received
0812 02:42:30.670023 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:30.670025 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:30.670109 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:30.670188 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:30.670910 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.671418 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.672250 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.672458 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.672539 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.675116 (+ 2577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:30.675119 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:30.675122 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:30.675147 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:30.676629 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:30.676986 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:30.676988 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:30.676989 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:30.677061 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:30.677285 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:30.677287 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:30.677288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:30.677449 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:30.677552 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:30.677728 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 02:42:30.677818 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 02:42:30.681138 13686 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37062:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:42:30.684226 13686 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:42:30.699133 14566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.692985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:46781 (local address 127.0.0.1:38270)
0812 02:42:30.694257 (+ 1272us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:30.694270 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:30.694365 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:30.694871 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:30.694877 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:30.694899 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:30.695093 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.695101 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.696217 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.696221 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.697486 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.697496 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.698554 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.698558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.698685 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.698728 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 02:42:30.698848 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 02:42:30.698969 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1212,"mutex_wait_us":46,"thread_start_us":79,"threads_started":1}
I20260812 02:42:30.699162 14569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.693779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38270 (local address 127.10.75.66:46781)
0812 02:42:30.694265 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:30.694278 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:30.694371 (+ 93us) server_negotiation.cc:407] Connection header received
0812 02:42:30.694499 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:30.694512 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:30.694714 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:30.694875 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:30.695231 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.696095 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.697615 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.698298 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.698406 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.698573 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:30.698900 (+ 327us) server_negotiation.cc:299] Negotiation successful
0812 02:42:30.699004 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":128,"threads_started":1}
I20260812 02:42:30.699678 14561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.692938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:37993 (local address 127.0.0.1:50244)
0812 02:42:30.693611 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:30.693664 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:30.693791 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:30.694886 (+ 1095us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:30.694889 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:30.694909 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:30.695103 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.695111 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.696571 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.696574 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.697846 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.697857 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.699250 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.699255 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.699368 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.699393 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 02:42:30.699463 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 02:42:30.699536 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"mutex_wait_us":58,"spinlock_wait_cycles":1408,"thread_start_us":95,"threads_started":1}
I20260812 02:42:30.700196 14559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.693269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:39331 (local address 127.0.0.1:35676)
0812 02:42:30.694456 (+ 1187us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:30.694470 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:30.694552 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:30.695049 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:30.695052 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:30.695066 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:30.695169 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.695177 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.696553 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.696557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.697967 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.697977 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.699569 (+ 1592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.699572 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.699664 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.699687 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 02:42:30.699945 (+ 258us) client_negotiation.cc:240] Negotiation successful
0812 02:42:30.700024 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1120,"mutex_wait_us":218,"thread_start_us":99,"threads_started":1}
I20260812 02:42:30.700634 14567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.693771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35676 (local address 127.10.75.67:39331)
0812 02:42:30.694603 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:30.694614 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:30.694639 (+ 25us) server_negotiation.cc:407] Connection header received
0812 02:42:30.694725 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:30.694730 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:30.694891 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:30.695026 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:30.695255 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.696408 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.698118 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.698887 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.698993 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.699152 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:30.700449 (+ 1297us) server_negotiation.cc:299] Negotiation successful
0812 02:42:30.700528 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":732,"thread_start_us":125,"threads_started":1}
I20260812 02:42:30.702240 14152 tablet_service.cc:1467] Processing CreateTablet for tablet b3a088de5d284c7982a802b1f752bf34 (DEFAULT_TABLE table=test-table [id=1c0165055477419081a31181094db50b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:30.703210 14152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3a088de5d284c7982a802b1f752bf34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:30.703102 14411 tablet_service.cc:1467] Processing CreateTablet for tablet b3a088de5d284c7982a802b1f752bf34 (DEFAULT_TABLE table=test-table [id=1c0165055477419081a31181094db50b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:30.704109 14411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3a088de5d284c7982a802b1f752bf34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:30.708590 14562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.693065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50244 (local address 127.10.75.65:37993)
0812 02:42:30.694137 (+ 1072us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:30.694146 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:30.694183 (+ 37us) server_negotiation.cc:407] Connection header received
0812 02:42:30.694268 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:30.694274 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:30.694583 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:30.694739 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:30.695251 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.696457 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.697991 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.698941 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.699037 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.699179 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:30.699961 (+ 782us) server_negotiation.cc:299] Negotiation successful
0812 02:42:30.708445 (+ 8484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":932,"thread_start_us":128,"threads_started":1}
I20260812 02:42:30.710155 14570 tablet_bootstrap.cc:492] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2: Bootstrap starting.
I20260812 02:42:30.711560 14573 tablet_bootstrap.cc:492] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29: Bootstrap starting.
I20260812 02:42:30.711374 13927 tablet_service.cc:1467] Processing CreateTablet for tablet b3a088de5d284c7982a802b1f752bf34 (DEFAULT_TABLE table=test-table [id=1c0165055477419081a31181094db50b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:30.712225 13927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3a088de5d284c7982a802b1f752bf34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:30.712560 14570 tablet_bootstrap.cc:654] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:30.713414 14570 log.cc:824] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:30.713586 14573 tablet_bootstrap.cc:654] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:30.714457 14573 log.cc:824] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:30.715579 14570 tablet_bootstrap.cc:492] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2: No bootstrap required, opened a new log
I20260812 02:42:30.715783 14570 ts_tablet_manager.cc:1397] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 02:42:30.716334 14573 tablet_bootstrap.cc:492] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29: No bootstrap required, opened a new log
I20260812 02:42:30.716531 14573 ts_tablet_manager.cc:1397] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 02:42:30.718722 14589 tablet_bootstrap.cc:492] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d: Bootstrap starting.
I20260812 02:42:30.719623 14570 raft_consensus.cc:348] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:30.719866 14570 raft_consensus.cc:374] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:30.719919 14570 raft_consensus.cc:729] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35216454ca59473da0299411c3b1e6e2, State: Initialized, Role: FOLLOWER
I20260812 02:42:30.719740 14573 raft_consensus.cc:348] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:30.720008 14573 raft_consensus.cc:374] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:30.720069 14573 raft_consensus.cc:729] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3837eed94d364463a8c1612e8f184a29, State: Initialized, Role: FOLLOWER
I20260812 02:42:30.720412 14570 consensus_queue.cc:260] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:30.720497 14573 consensus_queue.cc:260] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:30.721056 14527 heartbeater.cc:503] Master 127.10.75.126:35325 was elected leader, sending a full tablet report...
I20260812 02:42:30.721421 14570 ts_tablet_manager.cc:1428] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 02:42:30.721637 14573 ts_tablet_manager.cc:1428] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 02:42:30.721828 14589 tablet_bootstrap.cc:654] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:30.721982 14270 heartbeater.cc:503] Master 127.10.75.126:35325 was elected leader, sending a full tablet report...
I20260812 02:42:30.722873 14589 log.cc:824] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:30.725132 14589 tablet_bootstrap.cc:492] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d: No bootstrap required, opened a new log
I20260812 02:42:30.725364 14589 ts_tablet_manager.cc:1397] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260812 02:42:30.728924 14589 raft_consensus.cc:348] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:30.729130 14589 raft_consensus.cc:374] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:30.729197 14589 raft_consensus.cc:729] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1910b15781e5457487271de682c8fa5d, State: Initialized, Role: FOLLOWER
I20260812 02:42:30.729609 14589 consensus_queue.cc:260] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:30.730310 14039 heartbeater.cc:503] Master 127.10.75.126:35325 was elected leader, sending a full tablet report...
I20260812 02:42:30.730630 14589 ts_tablet_manager.cc:1428] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 02:42:30.736580 14593 raft_consensus.cc:482] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:42:30.736800 14593 raft_consensus.cc:504] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:30.737999 14593 leader_election.cc:288] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1910b15781e5457487271de682c8fa5d (127.10.75.65:37993), 35216454ca59473da0299411c3b1e6e2 (127.10.75.67:39331)
I20260812 02:42:30.742604 14090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.738319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:37993 (local address 127.10.75.66:53669)
0812 02:42:30.738470 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:30.738487 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:30.738619 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:30.738922 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:30.738927 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:30.738972 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:30.739124 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.739131 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.739867 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.739871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.741183 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.741194 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.742049 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.742052 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.742224 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.742246 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 02:42:30.742345 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 02:42:30.742420 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65,"mutex_wait_us":25,"spinlock_wait_cycles":768}
I20260812 02:42:30.742594 14562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.738317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:53669 (local address 127.10.75.65:37993)
0812 02:42:30.738434 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:30.738439 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:30.738582 (+ 143us) server_negotiation.cc:407] Connection header received
0812 02:42:30.738756 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:30.738761 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:30.738809 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:30.738874 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:30.739237 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.739751 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.741315 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.741928 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.742045 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.742137 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:30.742365 (+ 228us) server_negotiation.cc:299] Negotiation successful
0812 02:42:30.742440 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 02:42:30.743312 13960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3a088de5d284c7982a802b1f752bf34" candidate_uuid: "3837eed94d364463a8c1612e8f184a29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1910b15781e5457487271de682c8fa5d" is_pre_election: true
I20260812 02:42:30.743395 14596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.738321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:39331 (local address 127.10.75.66:36323)
0812 02:42:30.738838 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:30.738873 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:30.738983 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:30.739235 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:30.739240 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:30.739271 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:30.739749 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.739755 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.740923 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.740928 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.742129 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.742141 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.743070 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.743074 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.743166 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.743185 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 02:42:30.743247 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 02:42:30.743293 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"mutex_wait_us":213,"spinlock_wait_cycles":2816,"thread_start_us":142,"threads_started":1}
I20260812 02:42:30.743520 14567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.738398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:36323 (local address 127.10.75.67:39331)
0812 02:42:30.738549 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:30.738556 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:30.738967 (+ 411us) server_negotiation.cc:407] Connection header received
0812 02:42:30.739092 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:30.739094 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:30.739130 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:30.739220 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:30.740132 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.740817 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.742264 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.742817 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.742926 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.742993 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:30.743306 (+ 313us) server_negotiation.cc:299] Negotiation successful
0812 02:42:30.743396 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 02:42:30.743637 13960 raft_consensus.cc:2454] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3837eed94d364463a8c1612e8f184a29 in term 0.
I20260812 02:42:30.744112 14440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3a088de5d284c7982a802b1f752bf34" candidate_uuid: "3837eed94d364463a8c1612e8f184a29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35216454ca59473da0299411c3b1e6e2" is_pre_election: true
I20260812 02:42:30.744174 14080 leader_election.cc:302] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1910b15781e5457487271de682c8fa5d, 3837eed94d364463a8c1612e8f184a29; no voters:
I20260812 02:42:30.744371 14440 raft_consensus.cc:2454] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3837eed94d364463a8c1612e8f184a29 in term 0.
I20260812 02:42:30.744493 14593 raft_consensus.cc:2781] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:42:30.744612 14593 raft_consensus.cc:482] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:42:30.744692 14593 raft_consensus.cc:3037] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:30.745817 14593 raft_consensus.cc:504] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:30.746296 14593 leader_election.cc:288] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [CANDIDATE]: Term 1 election: Requested vote from peers 1910b15781e5457487271de682c8fa5d (127.10.75.65:37993), 35216454ca59473da0299411c3b1e6e2 (127.10.75.67:39331)
I20260812 02:42:30.746630 13960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3a088de5d284c7982a802b1f752bf34" candidate_uuid: "3837eed94d364463a8c1612e8f184a29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1910b15781e5457487271de682c8fa5d"
I20260812 02:42:30.746713 14440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3a088de5d284c7982a802b1f752bf34" candidate_uuid: "3837eed94d364463a8c1612e8f184a29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35216454ca59473da0299411c3b1e6e2"
I20260812 02:42:30.746786 13960 raft_consensus.cc:3037] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:30.746840 14440 raft_consensus.cc:3037] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:30.747874 14440 raft_consensus.cc:2454] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3837eed94d364463a8c1612e8f184a29 in term 1.
I20260812 02:42:30.747880 13960 raft_consensus.cc:2454] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3837eed94d364463a8c1612e8f184a29 in term 1.
I20260812 02:42:30.748206 14079 leader_election.cc:302] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35216454ca59473da0299411c3b1e6e2, 3837eed94d364463a8c1612e8f184a29; no voters:
I20260812 02:42:30.748382 14593 raft_consensus.cc:2781] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:30.748643 14593 raft_consensus.cc:686] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [term 1 LEADER]: Becoming Leader. State: Replica: 3837eed94d364463a8c1612e8f184a29, State: Running, Role: LEADER
I20260812 02:42:30.748984 14593 consensus_queue.cc:237] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:30.752630 13686 catalog_manager.cc:5495] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3837eed94d364463a8c1612e8f184a29 (127.10.75.66). New cstate: current_term: 1 leader_uuid: "3837eed94d364463a8c1612e8f184a29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } health_report { overall_health: UNKNOWN } } }
Aug 12 02:42:30 dist-test-slave-2p8l krb5kdc[13597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502549, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:30.795964 14607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.787696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35325 (local address 127.0.0.1:37068)
0812 02:42:30.787986 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:30.787999 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:30.788102 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:30.788322 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:30.788324 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:30.788718 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:30.788808 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.788814 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.789548 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.789551 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.790218 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:30.790228 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.790683 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.790686 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:30.790798 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.791406 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:30.791418 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:30.792872 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:30.794474 (+ 1602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:30.794483 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:30.794487 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:30.794717 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:30.795021 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:30.795023 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:30.795025 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:30.795108 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:30.795476 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:30.795482 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:30.795582 (+ 100us) client_negotiation.cc:769] Sending connection context
0812 02:42:30.795682 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 02:42:30.795807 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":89,"threads_started":1}
I20260812 02:42:30.795987 13782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:30.787789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37068 (local address 127.10.75.126:35325)
0812 02:42:30.787970 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:30.787975 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:30.788075 (+ 100us) server_negotiation.cc:407] Connection header received
0812 02:42:30.788171 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:30.788174 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:30.788212 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:30.788282 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:30.788915 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.789425 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.790323 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:30.790527 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:30.790653 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:30.792997 (+ 2344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:30.793000 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:30.793002 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:30.793022 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:30.794376 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:30.794815 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:30.794824 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:30.794826 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:30.794927 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:30.795203 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:30.795205 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:30.795206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:30.795371 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:30.795445 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:30.795742 (+ 297us) server_negotiation.cc:299] Negotiation successful
0812 02:42:30.795863 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":91}
I20260812 02:42:30.800047 13686 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:37068:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 02:42:30.800794 13686 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:42:30.805869 13927 tablet_service.cc:1467] Processing CreateTablet for tablet faa07999c7ab4f9b9202b7b970c00587 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f1d2d42f9e944e199d89ad430e4559da]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 02:42:30.805931 14152 tablet_service.cc:1467] Processing CreateTablet for tablet faa07999c7ab4f9b9202b7b970c00587 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f1d2d42f9e944e199d89ad430e4559da]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 02:42:30.806089 14411 tablet_service.cc:1467] Processing CreateTablet for tablet faa07999c7ab4f9b9202b7b970c00587 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f1d2d42f9e944e199d89ad430e4559da]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 02:42:30.806679 13927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet faa07999c7ab4f9b9202b7b970c00587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:30.806681 14411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet faa07999c7ab4f9b9202b7b970c00587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:30.806679 14152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet faa07999c7ab4f9b9202b7b970c00587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:30.809207 14589 tablet_bootstrap.cc:492] T faa07999c7ab4f9b9202b7b970c00587 P 1910b15781e5457487271de682c8fa5d: Bootstrap starting.
I20260812 02:42:30.809544 14573 tablet_bootstrap.cc:492] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29: Bootstrap starting.
I20260812 02:42:30.810118 14570 tablet_bootstrap.cc:492] T faa07999c7ab4f9b9202b7b970c00587 P 35216454ca59473da0299411c3b1e6e2: Bootstrap starting.
I20260812 02:42:30.810328 14589 tablet_bootstrap.cc:654] T faa07999c7ab4f9b9202b7b970c00587 P 1910b15781e5457487271de682c8fa5d: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:30.810750 14573 tablet_bootstrap.cc:654] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:30.811157 14570 tablet_bootstrap.cc:654] T faa07999c7ab4f9b9202b7b970c00587 P 35216454ca59473da0299411c3b1e6e2: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:30.811865 14589 tablet_bootstrap.cc:492] T faa07999c7ab4f9b9202b7b970c00587 P 1910b15781e5457487271de682c8fa5d: No bootstrap required, opened a new log
I20260812 02:42:30.811966 14589 ts_tablet_manager.cc:1397] T faa07999c7ab4f9b9202b7b970c00587 P 1910b15781e5457487271de682c8fa5d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 02:42:30.812135 14573 tablet_bootstrap.cc:492] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29: No bootstrap required, opened a new log
I20260812 02:42:30.812227 14573 ts_tablet_manager.cc:1397] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 02:42:30.812489 14570 tablet_bootstrap.cc:492] T faa07999c7ab4f9b9202b7b970c00587 P 35216454ca59473da0299411c3b1e6e2: No bootstrap required, opened a new log
I20260812 02:42:30.812469 14589 raft_consensus.cc:348] T faa07999c7ab4f9b9202b7b970c00587 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:30.812592 14570 ts_tablet_manager.cc:1397] T faa07999c7ab4f9b9202b7b970c00587 P 35216454ca59473da0299411c3b1e6e2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 02:42:30.812613 14589 raft_consensus.cc:374] T faa07999c7ab4f9b9202b7b970c00587 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:30.812652 14589 raft_consensus.cc:729] T faa07999c7ab4f9b9202b7b970c00587 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1910b15781e5457487271de682c8fa5d, State: Initialized, Role: FOLLOWER
I20260812 02:42:30.812659 14573 raft_consensus.cc:348] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:30.812765 14573 raft_consensus.cc:374] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:30.812796 14573 raft_consensus.cc:729] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3837eed94d364463a8c1612e8f184a29, State: Initialized, Role: FOLLOWER
I20260812 02:42:30.812808 14589 consensus_queue.cc:260] T faa07999c7ab4f9b9202b7b970c00587 P 1910b15781e5457487271de682c8fa5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:30.812918 14573 consensus_queue.cc:260] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:30.813086 14589 ts_tablet_manager.cc:1428] T faa07999c7ab4f9b9202b7b970c00587 P 1910b15781e5457487271de682c8fa5d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 02:42:30.813163 14573 ts_tablet_manager.cc:1428] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 02:42:30.813130 14570 raft_consensus.cc:348] T faa07999c7ab4f9b9202b7b970c00587 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:30.813328 14570 raft_consensus.cc:374] T faa07999c7ab4f9b9202b7b970c00587 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:30.813374 14570 raft_consensus.cc:729] T faa07999c7ab4f9b9202b7b970c00587 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35216454ca59473da0299411c3b1e6e2, State: Initialized, Role: FOLLOWER
I20260812 02:42:30.813532 14570 consensus_queue.cc:260] T faa07999c7ab4f9b9202b7b970c00587 P 35216454ca59473da0299411c3b1e6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:30.813822 14595 tablet_replica.cc:439] T faa07999c7ab4f9b9202b7b970c00587 P 1910b15781e5457487271de682c8fa5d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } } }
I20260812 02:42:30.813982 14595 tablet_replica.cc:442] T faa07999c7ab4f9b9202b7b970c00587 P 1910b15781e5457487271de682c8fa5d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 02:42:30.814218 14593 tablet_replica.cc:439] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } } }
I20260812 02:42:30.814353 14593 tablet_replica.cc:442] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 02:42:30.815445 14570 ts_tablet_manager.cc:1428] T faa07999c7ab4f9b9202b7b970c00587 P 35216454ca59473da0299411c3b1e6e2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 02:42:30.815471 14590 tablet_replica.cc:439] T faa07999c7ab4f9b9202b7b970c00587 P 35216454ca59473da0299411c3b1e6e2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } } }
I20260812 02:42:30.815670 14590 tablet_replica.cc:442] T faa07999c7ab4f9b9202b7b970c00587 P 35216454ca59473da0299411c3b1e6e2: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 02:42:30.889328 14531 tablet.cc:2369] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 02:42:30.908239 14273 tablet.cc:2369] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 02:42:30.938037 14040 tablet.cc:2369] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:42:31.300136 14593 raft_consensus.cc:482] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:42:31.300287 14593 raft_consensus.cc:504] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:31.300814 14593 leader_election.cc:288] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1910b15781e5457487271de682c8fa5d (127.10.75.65:37993), 35216454ca59473da0299411c3b1e6e2 (127.10.75.67:39331)
I20260812 02:42:31.301371 14440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faa07999c7ab4f9b9202b7b970c00587" candidate_uuid: "3837eed94d364463a8c1612e8f184a29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35216454ca59473da0299411c3b1e6e2" is_pre_election: true
I20260812 02:42:31.301426 13960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faa07999c7ab4f9b9202b7b970c00587" candidate_uuid: "3837eed94d364463a8c1612e8f184a29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1910b15781e5457487271de682c8fa5d" is_pre_election: true
I20260812 02:42:31.301518 14440 raft_consensus.cc:2454] T faa07999c7ab4f9b9202b7b970c00587 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3837eed94d364463a8c1612e8f184a29 in term 0.
I20260812 02:42:31.301620 13960 raft_consensus.cc:2454] T faa07999c7ab4f9b9202b7b970c00587 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3837eed94d364463a8c1612e8f184a29 in term 0.
I20260812 02:42:31.301880 14079 leader_election.cc:302] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35216454ca59473da0299411c3b1e6e2, 3837eed94d364463a8c1612e8f184a29; no voters:
I20260812 02:42:31.302134 14593 raft_consensus.cc:2781] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:42:31.302222 14593 raft_consensus.cc:482] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:42:31.302276 14593 raft_consensus.cc:3037] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:31.303296 14593 raft_consensus.cc:504] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:31.303632 14593 leader_election.cc:288] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 [CANDIDATE]: Term 1 election: Requested vote from peers 1910b15781e5457487271de682c8fa5d (127.10.75.65:37993), 35216454ca59473da0299411c3b1e6e2 (127.10.75.67:39331)
I20260812 02:42:31.304044 14440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faa07999c7ab4f9b9202b7b970c00587" candidate_uuid: "3837eed94d364463a8c1612e8f184a29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35216454ca59473da0299411c3b1e6e2"
I20260812 02:42:31.304174 14440 raft_consensus.cc:3037] T faa07999c7ab4f9b9202b7b970c00587 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:31.304199 13960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faa07999c7ab4f9b9202b7b970c00587" candidate_uuid: "3837eed94d364463a8c1612e8f184a29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1910b15781e5457487271de682c8fa5d"
I20260812 02:42:31.304347 13960 raft_consensus.cc:3037] T faa07999c7ab4f9b9202b7b970c00587 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:31.305290 14440 raft_consensus.cc:2454] T faa07999c7ab4f9b9202b7b970c00587 P 35216454ca59473da0299411c3b1e6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3837eed94d364463a8c1612e8f184a29 in term 1.
I20260812 02:42:31.305528 13960 raft_consensus.cc:2454] T faa07999c7ab4f9b9202b7b970c00587 P 1910b15781e5457487271de682c8fa5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3837eed94d364463a8c1612e8f184a29 in term 1.
I20260812 02:42:31.305641 14079 leader_election.cc:302] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35216454ca59473da0299411c3b1e6e2, 3837eed94d364463a8c1612e8f184a29; no voters:
I20260812 02:42:31.305828 14593 raft_consensus.cc:2781] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:31.306005 14593 raft_consensus.cc:686] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 [term 1 LEADER]: Becoming Leader. State: Replica: 3837eed94d364463a8c1612e8f184a29, State: Running, Role: LEADER
I20260812 02:42:31.306193 14593 consensus_queue.cc:237] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:31.306876 14615 tablet_replica.cc:439] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29: TxnStatusTablet state changed. Reason: New leader 3837eed94d364463a8c1612e8f184a29. Latest consensus state: current_term: 1 leader_uuid: "3837eed94d364463a8c1612e8f184a29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } } }
I20260812 02:42:31.307009 14615 tablet_replica.cc:442] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29: This TxnStatusTablet replica's current role is: LEADER
I20260812 02:42:31.307334 14618 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 02:42:31.307602 14618 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 02:42:31.308077 13687 catalog_manager.cc:5495] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3837eed94d364463a8c1612e8f184a29 (127.10.75.66). New cstate: current_term: 1 leader_uuid: "3837eed94d364463a8c1612e8f184a29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260812 02:42:31.328359 14615 consensus_queue.cc:1035] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:31.335055 14615 consensus_queue.cc:1035] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:31.380705 14636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:31.376559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:46781 (local address 127.0.0.1:38284)
0812 02:42:31.376873 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:31.376891 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:31.377019 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:31.377375 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:31.377378 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:31.377387 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 02:42:31.377508 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:31.377517 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.378427 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.378432 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:31.379056 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:31.379065 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.379562 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.379566 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:31.379664 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:31.379721 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 02:42:31.380386 (+ 665us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 02:42:31.380404 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 02:42:31.380477 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 02:42:31.380565 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":114,"threads_started":1}
I20260812 02:42:31.380718 14638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:31.376667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38284 (local address 127.10.75.66:46781)
0812 02:42:31.376991 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:31.377000 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:31.377015 (+ 15us) server_negotiation.cc:407] Connection header received
0812 02:42:31.377166 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:31.377170 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:31.377236 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:31.377359 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:42:31.377658 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.378319 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.379204 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.379444 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.379560 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:31.379881 (+ 321us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:42:31.380285 (+ 404us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:42:31.380410 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:31.380487 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 02:42:31.380538 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":109,"threads_started":1}
I20260812 02:42:31.385874 13960 raft_consensus.cc:1261] T faa07999c7ab4f9b9202b7b970c00587 P 1910b15781e5457487271de682c8fa5d [term 1 FOLLOWER]: Refusing update from remote peer 3837eed94d364463a8c1612e8f184a29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:42:31.385874 14440 raft_consensus.cc:1261] T faa07999c7ab4f9b9202b7b970c00587 P 35216454ca59473da0299411c3b1e6e2 [term 1 FOLLOWER]: Refusing update from remote peer 3837eed94d364463a8c1612e8f184a29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:42:31.386386 14627 consensus_queue.cc:1035] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:31.386636 14593 consensus_queue.cc:1035] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:31.389014 14631 tablet_replica.cc:439] T faa07999c7ab4f9b9202b7b970c00587 P 35216454ca59473da0299411c3b1e6e2: TxnStatusTablet state changed. Reason: New leader 3837eed94d364463a8c1612e8f184a29. Latest consensus state: current_term: 1 leader_uuid: "3837eed94d364463a8c1612e8f184a29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } } }
I20260812 02:42:31.389133 14631 tablet_replica.cc:442] T faa07999c7ab4f9b9202b7b970c00587 P 35216454ca59473da0299411c3b1e6e2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 02:42:31.390578 14623 tablet_replica.cc:439] T faa07999c7ab4f9b9202b7b970c00587 P 1910b15781e5457487271de682c8fa5d: TxnStatusTablet state changed. Reason: New leader 3837eed94d364463a8c1612e8f184a29. Latest consensus state: current_term: 1 leader_uuid: "3837eed94d364463a8c1612e8f184a29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } } }
I20260812 02:42:31.390704 14623 tablet_replica.cc:442] T faa07999c7ab4f9b9202b7b970c00587 P 1910b15781e5457487271de682c8fa5d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 02:42:31.392706 14625 mvcc.cc:205] Tried to move back new op lower bound from 7317514450470916096 to 7317514450151436288. Current Snapshot: MvccSnapshot[applied={T|T < 7317514450470916096}]
I20260812 02:42:31.393102 14627 tablet_replica.cc:439] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3837eed94d364463a8c1612e8f184a29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } } }
I20260812 02:42:31.393214 14627 tablet_replica.cc:442] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29: This TxnStatusTablet replica's current role is: LEADER
I20260812 02:42:31.393186 14623 tablet_replica.cc:439] T faa07999c7ab4f9b9202b7b970c00587 P 1910b15781e5457487271de682c8fa5d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3837eed94d364463a8c1612e8f184a29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } } }
I20260812 02:42:31.393290 14623 tablet_replica.cc:442] T faa07999c7ab4f9b9202b7b970c00587 P 1910b15781e5457487271de682c8fa5d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 02:42:31.393328 14627 tablet_replica.cc:439] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3837eed94d364463a8c1612e8f184a29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } } }
I20260812 02:42:31.393388 14627 tablet_replica.cc:442] T faa07999c7ab4f9b9202b7b970c00587 P 3837eed94d364463a8c1612e8f184a29: This TxnStatusTablet replica's current role is: LEADER
I20260812 02:42:31.393514 14631 tablet_replica.cc:439] T faa07999c7ab4f9b9202b7b970c00587 P 35216454ca59473da0299411c3b1e6e2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3837eed94d364463a8c1612e8f184a29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } } }
I20260812 02:42:31.393594 14634 mvcc.cc:205] Tried to move back new op lower bound from 7317514450470916096 to 7317514450151436288. Current Snapshot: MvccSnapshot[applied={T|T < 7317514450470916096}]
I20260812 02:42:31.393618 14631 tablet_replica.cc:442] T faa07999c7ab4f9b9202b7b970c00587 P 35216454ca59473da0299411c3b1e6e2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 02:42:31.405782 14638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:31.402095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38286 (local address 127.10.75.66:46781)
0812 02:42:31.402243 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:31.402248 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:31.402503 (+ 255us) server_negotiation.cc:407] Connection header received
0812 02:42:31.402638 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:31.402642 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:31.402683 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:31.402747 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:42:31.403018 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.403504 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.404758 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.404965 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.405044 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:31.405338 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:42:31.405401 (+ 63us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:42:31.405455 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:31.405589 (+ 134us) server_negotiation.cc:299] Negotiation successful
0812 02:42:31.405635 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 02:42:31.424878 14638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:31.417970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:47959 (local address 127.10.75.66:46781)
0812 02:42:31.418092 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:31.418096 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:31.421376 (+ 3280us) server_negotiation.cc:407] Connection header received
0812 02:42:31.421463 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:31.421466 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:31.421516 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:31.421599 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:42:31.421933 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.422694 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.423690 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.423905 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.424025 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:31.424357 (+ 332us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:42:31.424428 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:42:31.424522 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:31.424635 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 02:42:31.424713 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":37}
I20260812 02:42:31.424886 14649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:31.417890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:46781 (local address 127.10.75.66:47959)
0812 02:42:31.421264 (+ 3374us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:31.421278 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:31.421378 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:31.421617 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:31.421619 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:31.421672 (+ 53us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 02:42:31.421803 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:31.421807 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.422826 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.422828 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:31.423510 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:31.423519 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.424039 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.424042 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:31.424162 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:31.424202 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 02:42:31.424526 (+ 324us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 02:42:31.424533 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 02:42:31.424647 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 02:42:31.424724 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3283,"mutex_wait_us":23,"thread_start_us":97,"threads_started":1}
I20260812 02:42:31.467650 13687 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:42:31.467864 13687 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:42:31.470366 13687 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54: Sending DeleteTablet for 3 replicas of tablet b3a088de5d284c7982a802b1f752bf34
I20260812 02:42:31.471045 14151 tablet_service.cc:1514] Processing DeleteTablet for tablet b3a088de5d284c7982a802b1f752bf34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:31 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:38270
I20260812 02:42:31.471271 14411 tablet_service.cc:1514] Processing DeleteTablet for tablet b3a088de5d284c7982a802b1f752bf34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:31 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:35676
I20260812 02:42:31.471285 13927 tablet_service.cc:1514] Processing DeleteTablet for tablet b3a088de5d284c7982a802b1f752bf34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:31 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:50244
I20260812 02:42:31.471617 14651 tablet_replica.cc:330] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29: stopping tablet replica
I20260812 02:42:31.471947 14657 tablet_replica.cc:330] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2: stopping tablet replica
I20260812 02:42:31.471939 14651 raft_consensus.cc:2229] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:42:31.472275 14657 raft_consensus.cc:2229] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:42:31.472362 14651 raft_consensus.cc:2258] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:31.472435 13687 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37062:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 02:42:31.472584 14657 raft_consensus.cc:2258] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 02:42:31.472868 13687 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:42:31.472990 14658 tablet_replica.cc:330] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d: stopping tablet replica
I20260812 02:42:31.473285 14658 raft_consensus.cc:2229] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:42:31.473502 14658 raft_consensus.cc:2258] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:31.474895 14658 ts_tablet_manager.cc:1905] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:31.475035 14651 ts_tablet_manager.cc:1905] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:31.477883 14651 ts_tablet_manager.cc:1918] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 02:42:31.477975 14651 log.cc:1196] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/b3a088de5d284c7982a802b1f752bf34
I20260812 02:42:31.477977 14658 ts_tablet_manager.cc:1918] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 02:42:31.478101 14658 log.cc:1196] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/wal/wals/b3a088de5d284c7982a802b1f752bf34
I20260812 02:42:31.478313 14651 ts_tablet_manager.cc:1939] T b3a088de5d284c7982a802b1f752bf34 P 3837eed94d364463a8c1612e8f184a29: Deleting consensus metadata
I20260812 02:42:31.478430 14658 ts_tablet_manager.cc:1939] T b3a088de5d284c7982a802b1f752bf34 P 1910b15781e5457487271de682c8fa5d: Deleting consensus metadata
I20260812 02:42:31.478457 13927 tablet_service.cc:1467] Processing CreateTablet for tablet 047845118cf049d195fb1bdb039ec4e7 (DEFAULT_TABLE table=test-table [id=5c244d3a11d54c12bb15efa7c13e440c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:31.478722 13927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 047845118cf049d195fb1bdb039ec4e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:31.479851 14151 tablet_service.cc:1467] Processing CreateTablet for tablet 047845118cf049d195fb1bdb039ec4e7 (DEFAULT_TABLE table=test-table [id=5c244d3a11d54c12bb15efa7c13e440c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:31.480116 14151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 047845118cf049d195fb1bdb039ec4e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:31.480185 14411 tablet_service.cc:1467] Processing CreateTablet for tablet 047845118cf049d195fb1bdb039ec4e7 (DEFAULT_TABLE table=test-table [id=5c244d3a11d54c12bb15efa7c13e440c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:31.480444 14411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 047845118cf049d195fb1bdb039ec4e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:31.480997 13659 catalog_manager.cc:4841] TS 3837eed94d364463a8c1612e8f184a29 (127.10.75.66:46781): tablet b3a088de5d284c7982a802b1f752bf34 (table test-table [id=1c0165055477419081a31181094db50b]) successfully deleted
I20260812 02:42:31.481374 13666 catalog_manager.cc:4841] TS 1910b15781e5457487271de682c8fa5d (127.10.75.65:37993): tablet b3a088de5d284c7982a802b1f752bf34 (table test-table [id=1c0165055477419081a31181094db50b]) successfully deleted
I20260812 02:42:31.481901 14664 tablet_bootstrap.cc:492] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d: Bootstrap starting.
I20260812 02:42:31.482885 14669 tablet_bootstrap.cc:492] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2: Bootstrap starting.
I20260812 02:42:31.482949 14664 tablet_bootstrap.cc:654] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:31.483937 14669 tablet_bootstrap.cc:654] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:31.484189 14657 ts_tablet_manager.cc:1905] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:31.484704 14667 tablet_bootstrap.cc:492] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29: Bootstrap starting.
I20260812 02:42:31.485378 14667 tablet_bootstrap.cc:654] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:31.486589 14669 tablet_bootstrap.cc:492] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2: No bootstrap required, opened a new log
I20260812 02:42:31.486707 14669 ts_tablet_manager.cc:1397] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 02:42:31.487229 14669 raft_consensus.cc:348] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:31.487329 14669 raft_consensus.cc:374] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:31.487378 14669 raft_consensus.cc:729] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35216454ca59473da0299411c3b1e6e2, State: Initialized, Role: FOLLOWER
I20260812 02:42:31.487504 14657 ts_tablet_manager.cc:1918] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 02:42:31.487542 14669 consensus_queue.cc:260] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:31.487637 14657 log.cc:1196] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/b3a088de5d284c7982a802b1f752bf34
I20260812 02:42:31.488005 14657 ts_tablet_manager.cc:1939] T b3a088de5d284c7982a802b1f752bf34 P 35216454ca59473da0299411c3b1e6e2: Deleting consensus metadata
I20260812 02:42:31.488265 14669 ts_tablet_manager.cc:1428] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260812 02:42:31.488866 14667 tablet_bootstrap.cc:492] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29: No bootstrap required, opened a new log
I20260812 02:42:31.488950 14667 ts_tablet_manager.cc:1397] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260812 02:42:31.489296 13664 catalog_manager.cc:4841] TS 35216454ca59473da0299411c3b1e6e2 (127.10.75.67:39331): tablet b3a088de5d284c7982a802b1f752bf34 (table test-table [id=1c0165055477419081a31181094db50b]) successfully deleted
I20260812 02:42:31.489363 14667 raft_consensus.cc:348] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:31.489492 14667 raft_consensus.cc:374] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:31.489532 14667 raft_consensus.cc:729] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3837eed94d364463a8c1612e8f184a29, State: Initialized, Role: FOLLOWER
I20260812 02:42:31.489667 14667 consensus_queue.cc:260] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:31.490003 14667 ts_tablet_manager.cc:1428] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 02:42:31.490832 14664 tablet_bootstrap.cc:492] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d: No bootstrap required, opened a new log
I20260812 02:42:31.490926 14664 ts_tablet_manager.cc:1397] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260812 02:42:31.491385 14664 raft_consensus.cc:348] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:31.491489 14664 raft_consensus.cc:374] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:31.491518 14664 raft_consensus.cc:729] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1910b15781e5457487271de682c8fa5d, State: Initialized, Role: FOLLOWER
I20260812 02:42:31.491696 14664 consensus_queue.cc:260] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:31.491954 14664 ts_tablet_manager.cc:1428] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 02:42:31.602463 14631 raft_consensus.cc:482] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:42:31.602643 14631 raft_consensus.cc:504] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:31.603888 14631 leader_election.cc:288] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1910b15781e5457487271de682c8fa5d (127.10.75.65:37993), 3837eed94d364463a8c1612e8f184a29 (127.10.75.66:46781)
I20260812 02:42:31.609093 14675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:31.604105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:37993 (local address 127.10.75.67:52765)
0812 02:42:31.604552 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:31.604568 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:31.604706 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:31.605239 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:31.605242 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:31.605262 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:31.605395 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:31.605401 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.606463 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.606466 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:31.607327 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:31.607337 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.608603 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.608607 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:31.608728 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:31.608755 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 02:42:31.608834 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 02:42:31.608914 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"spinlock_wait_cycles":21376,"thread_start_us":134,"threads_started":1}
I20260812 02:42:31.609076 14638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:31.604635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:58135 (local address 127.10.75.66:46781)
0812 02:42:31.604757 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:31.604762 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:31.604779 (+ 17us) server_negotiation.cc:407] Connection header received
0812 02:42:31.604837 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:31.604840 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:31.604887 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:31.604973 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:31.605399 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.606296 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.607844 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.608455 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.608569 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:31.608615 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:31.608882 (+ 267us) server_negotiation.cc:299] Negotiation successful
0812 02:42:31.608960 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 02:42:31.609477 14677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:31.604174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:46781 (local address 127.10.75.67:58135)
0812 02:42:31.604584 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:31.604601 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:31.604706 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:31.605022 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:31.605026 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:31.605048 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:31.605214 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:31.605223 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.606429 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.606433 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:31.607685 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:31.607697 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.608662 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.608665 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:31.608755 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:31.608772 (+ 17us) client_negotiation.cc:769] Sending connection context
0812 02:42:31.609250 (+ 478us) client_negotiation.cc:240] Negotiation successful
0812 02:42:31.609338 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"mutex_wait_us":52,"spinlock_wait_cycles":11392,"thread_start_us":107,"threads_started":1}
I20260812 02:42:31.609560 14678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:31.604272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:52765 (local address 127.10.75.65:37993)
0812 02:42:31.604961 (+ 689us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:31.604971 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:31.604989 (+ 18us) server_negotiation.cc:407] Connection header received
0812 02:42:31.605048 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:31.605051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:31.605104 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:31.605204 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:31.605528 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.606338 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.607492 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.608329 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.608453 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:31.608536 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:31.609328 (+ 792us) server_negotiation.cc:299] Negotiation successful
0812 02:42:31.609406 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":137,"threads_started":1}
I20260812 02:42:31.609964 13960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "047845118cf049d195fb1bdb039ec4e7" candidate_uuid: "35216454ca59473da0299411c3b1e6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1910b15781e5457487271de682c8fa5d" is_pre_election: true
I20260812 02:42:31.610203 13960 raft_consensus.cc:2454] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35216454ca59473da0299411c3b1e6e2 in term 0.
I20260812 02:42:31.610309 14192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "047845118cf049d195fb1bdb039ec4e7" candidate_uuid: "35216454ca59473da0299411c3b1e6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3837eed94d364463a8c1612e8f184a29" is_pre_election: true
I20260812 02:42:31.610558 14192 raft_consensus.cc:2454] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35216454ca59473da0299411c3b1e6e2 in term 0.
I20260812 02:42:31.610709 14329 leader_election.cc:302] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1910b15781e5457487271de682c8fa5d, 35216454ca59473da0299411c3b1e6e2; no voters:
I20260812 02:42:31.610989 14631 raft_consensus.cc:2781] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:42:31.611052 14631 raft_consensus.cc:482] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:42:31.611090 14631 raft_consensus.cc:3037] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:31.612185 14631 raft_consensus.cc:504] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:31.612545 14631 leader_election.cc:288] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [CANDIDATE]: Term 1 election: Requested vote from peers 1910b15781e5457487271de682c8fa5d (127.10.75.65:37993), 3837eed94d364463a8c1612e8f184a29 (127.10.75.66:46781)
I20260812 02:42:31.612841 13960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "047845118cf049d195fb1bdb039ec4e7" candidate_uuid: "35216454ca59473da0299411c3b1e6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1910b15781e5457487271de682c8fa5d"
I20260812 02:42:31.612972 14192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "047845118cf049d195fb1bdb039ec4e7" candidate_uuid: "35216454ca59473da0299411c3b1e6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3837eed94d364463a8c1612e8f184a29"
I20260812 02:42:31.613001 13960 raft_consensus.cc:3037] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:31.613092 14192 raft_consensus.cc:3037] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:31.614214 14192 raft_consensus.cc:2454] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35216454ca59473da0299411c3b1e6e2 in term 1.
I20260812 02:42:31.614214 13960 raft_consensus.cc:2454] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35216454ca59473da0299411c3b1e6e2 in term 1.
I20260812 02:42:31.614529 14323 leader_election.cc:302] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35216454ca59473da0299411c3b1e6e2, 3837eed94d364463a8c1612e8f184a29; no voters:
I20260812 02:42:31.614686 14631 raft_consensus.cc:2781] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:31.614916 14631 raft_consensus.cc:686] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 35216454ca59473da0299411c3b1e6e2, State: Running, Role: LEADER
I20260812 02:42:31.615223 14631 consensus_queue.cc:237] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:31.617919 13687 catalog_manager.cc:5495] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35216454ca59473da0299411c3b1e6e2 (127.10.75.67). New cstate: current_term: 1 leader_uuid: "35216454ca59473da0299411c3b1e6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } health_report { overall_health: HEALTHY } } }
I20260812 02:42:31.652002 14682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:31.648178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35686 (local address 127.10.75.67:39331)
0812 02:42:31.648530 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:31.648538 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:31.648558 (+ 20us) server_negotiation.cc:407] Connection header received
0812 02:42:31.648616 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:31.648618 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:31.648666 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:31.648789 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:42:31.649039 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.649608 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.650517 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.650754 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.650862 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:31.651160 (+ 298us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:42:31.651557 (+ 397us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:42:31.651692 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:31.651803 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 02:42:31.651857 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":170,"threads_started":1}
I20260812 02:42:31.661760 14638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:31.658691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:58817 (local address 127.10.75.66:46781)
0812 02:42:31.658834 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:31.658837 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:31.659040 (+ 203us) server_negotiation.cc:407] Connection header received
0812 02:42:31.659158 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:31.659160 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:31.659203 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:31.659273 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:42:31.659495 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.659984 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.660865 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.661066 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.661147 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:31.661390 (+ 243us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:42:31.661452 (+ 62us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:42:31.661504 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:31.661611 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 02:42:31.661658 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 02:42:31.661782 14688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:31.658535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:46781 (local address 127.10.75.67:58817)
0812 02:42:31.658937 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:31.658956 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:31.659056 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:31.659295 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:31.659297 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:31.659303 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 02:42:31.659404 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:31.659408 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.660091 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.660096 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:31.660757 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:31.660766 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.661162 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.661165 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:31.661234 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:31.661275 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 02:42:31.661541 (+ 266us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 02:42:31.661546 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 02:42:31.661593 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 02:42:31.661670 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":116,"threads_started":1}
I20260812 02:42:31.667721 13960 raft_consensus.cc:1261] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d [term 1 FOLLOWER]: Refusing update from remote peer 35216454ca59473da0299411c3b1e6e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:42:31.668074 14192 raft_consensus.cc:1261] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29 [term 1 FOLLOWER]: Refusing update from remote peer 35216454ca59473da0299411c3b1e6e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:42:31.668246 14680 consensus_queue.cc:1035] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:31.668607 14631 consensus_queue.cc:1035] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:31.671669 14630 mvcc.cc:205] Tried to move back new op lower bound from 7317514451626893312 to 7317514451418873856. Current Snapshot: MvccSnapshot[applied={T|T < 7317514451626893312}]
I20260812 02:42:31.686484 14649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:31.683015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:39331 (local address 127.10.75.66:42201)
0812 02:42:31.683144 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:31.683161 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:31.683245 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:31.683563 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:31.683567 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:31.683578 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 02:42:31.683689 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:31.683696 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.684399 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.684401 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:31.685083 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:31.685094 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.685663 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.685667 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:31.685760 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:31.685799 (+ 39us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 02:42:31.686155 (+ 356us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 02:42:31.686165 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 02:42:31.686235 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 02:42:31.686344 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 02:42:31.686853 14682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:31.683058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:42201 (local address 127.10.75.67:39331)
0812 02:42:31.683333 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:31.683338 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:31.683351 (+ 13us) server_negotiation.cc:407] Connection header received
0812 02:42:31.683395 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:31.683398 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:31.683451 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:31.683528 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:42:31.683801 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.684301 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.685233 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:31.685524 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:31.685637 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:31.685927 (+ 290us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:42:31.686012 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:42:31.686115 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:31.686690 (+ 575us) server_negotiation.cc:299] Negotiation successful
0812 02:42:31.686749 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192}
W20260812 02:42:31.687415 14634 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 02:42:33.247495 13684 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:42:33.247702 13684 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:42:33.250597 13684 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54: Sending DeleteTablet for 3 replicas of tablet 047845118cf049d195fb1bdb039ec4e7
I20260812 02:42:33.251359 13927 tablet_service.cc:1514] Processing DeleteTablet for tablet 047845118cf049d195fb1bdb039ec4e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:33 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:50244
I20260812 02:42:33.251489 14411 tablet_service.cc:1514] Processing DeleteTablet for tablet 047845118cf049d195fb1bdb039ec4e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:33 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:35676
I20260812 02:42:33.251557 14151 tablet_service.cc:1514] Processing DeleteTablet for tablet 047845118cf049d195fb1bdb039ec4e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:33 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:38270
I20260812 02:42:33.251914 14733 tablet_replica.cc:330] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29: stopping tablet replica
I20260812 02:42:33.251969 14732 tablet_replica.cc:330] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2: stopping tablet replica
I20260812 02:42:33.252048 14729 tablet_replica.cc:330] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d: stopping tablet replica
I20260812 02:42:33.252113 14733 raft_consensus.cc:2229] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:42:33.252113 14732 raft_consensus.cc:2229] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:42:33.252286 14733 raft_consensus.cc:2258] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:33.252324 14729 raft_consensus.cc:2229] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:42:33.252538 14729 raft_consensus.cc:2258] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:33.252810 14732 raft_consensus.cc:2258] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:33.253085 14733 ts_tablet_manager.cc:1905] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:33.253413 14729 ts_tablet_manager.cc:1905] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:33.253556 14732 ts_tablet_manager.cc:1905] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:33.256551 14733 ts_tablet_manager.cc:1918] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 02:42:33.256687 14733 log.cc:1196] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/047845118cf049d195fb1bdb039ec4e7
I20260812 02:42:33.256701 14732 ts_tablet_manager.cc:1918] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 02:42:33.256819 14732 log.cc:1196] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/047845118cf049d195fb1bdb039ec4e7
I20260812 02:42:33.257006 14729 ts_tablet_manager.cc:1918] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 02:42:33.257082 14733 ts_tablet_manager.cc:1939] T 047845118cf049d195fb1bdb039ec4e7 P 3837eed94d364463a8c1612e8f184a29: Deleting consensus metadata
I20260812 02:42:33.257103 14729 log.cc:1196] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/wal/wals/047845118cf049d195fb1bdb039ec4e7
I20260812 02:42:33.257165 14732 ts_tablet_manager.cc:1939] T 047845118cf049d195fb1bdb039ec4e7 P 35216454ca59473da0299411c3b1e6e2: Deleting consensus metadata
I20260812 02:42:33.257393 14729 ts_tablet_manager.cc:1939] T 047845118cf049d195fb1bdb039ec4e7 P 1910b15781e5457487271de682c8fa5d: Deleting consensus metadata
I20260812 02:42:33.257905 13659 catalog_manager.cc:4841] TS 3837eed94d364463a8c1612e8f184a29 (127.10.75.66:46781): tablet 047845118cf049d195fb1bdb039ec4e7 (table test-table [id=5c244d3a11d54c12bb15efa7c13e440c]) successfully deleted
I20260812 02:42:33.257943 13664 catalog_manager.cc:4841] TS 35216454ca59473da0299411c3b1e6e2 (127.10.75.67:39331): tablet 047845118cf049d195fb1bdb039ec4e7 (table test-table [id=5c244d3a11d54c12bb15efa7c13e440c]) successfully deleted
I20260812 02:42:33.258157 13666 catalog_manager.cc:4841] TS 1910b15781e5457487271de682c8fa5d (127.10.75.65:37993): tablet 047845118cf049d195fb1bdb039ec4e7 (table test-table [id=5c244d3a11d54c12bb15efa7c13e440c]) successfully deleted
Aug 12 02:42:33 dist-test-slave-2p8l krb5kdc[13597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502553, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 02:42:33 dist-test-slave-2p8l krb5kdc[13597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502553, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:33.287348 14751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:33.277038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37072 (local address 127.10.75.126:35325)
0812 02:42:33.277426 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:33.277440 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:33.277551 (+ 111us) server_negotiation.cc:407] Connection header received
0812 02:42:33.277770 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:33.277773 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:33.277827 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:33.277936 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:33.278774 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.279401 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.280320 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.280592 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.280709 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:33.283713 (+ 3004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:33.283718 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:33.283720 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:33.283749 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:33.285429 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:33.285883 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:33.285892 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:33.285894 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:33.285988 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:33.286301 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:33.286305 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:33.286307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:33.286531 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:33.286692 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:33.286961 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 02:42:33.287123 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":147,"threads_started":1}
I20260812 02:42:33.290580 13684 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37072:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:42:33.291225 13684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:42:33.297046 13927 tablet_service.cc:1467] Processing CreateTablet for tablet 3f5a03b2ffc04843a7a4b01695c8e5b7 (DEFAULT_TABLE table=test-table [id=fd3ced6de9984338863fb030464c67c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:33.297209 14151 tablet_service.cc:1467] Processing CreateTablet for tablet 3f5a03b2ffc04843a7a4b01695c8e5b7 (DEFAULT_TABLE table=test-table [id=fd3ced6de9984338863fb030464c67c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:33.297441 13927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f5a03b2ffc04843a7a4b01695c8e5b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:33.297654 14151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f5a03b2ffc04843a7a4b01695c8e5b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:33.300311 14753 tablet_bootstrap.cc:492] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d: Bootstrap starting.
I20260812 02:42:33.300815 14755 tablet_bootstrap.cc:492] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29: Bootstrap starting.
I20260812 02:42:33.301144 14411 tablet_service.cc:1467] Processing CreateTablet for tablet 3f5a03b2ffc04843a7a4b01695c8e5b7 (DEFAULT_TABLE table=test-table [id=fd3ced6de9984338863fb030464c67c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:33.301529 14411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f5a03b2ffc04843a7a4b01695c8e5b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:33.301647 14753 tablet_bootstrap.cc:654] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:33.301851 14755 tablet_bootstrap.cc:654] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:33.303840 14753 tablet_bootstrap.cc:492] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d: No bootstrap required, opened a new log
I20260812 02:42:33.304013 14753 ts_tablet_manager.cc:1397] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 02:42:33.304657 14753 raft_consensus.cc:348] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:33.304816 14753 raft_consensus.cc:374] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:33.304880 14753 raft_consensus.cc:729] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1910b15781e5457487271de682c8fa5d, State: Initialized, Role: FOLLOWER
I20260812 02:42:33.305045 14753 consensus_queue.cc:260] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:33.305641 14753 ts_tablet_manager.cc:1428] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 02:42:33.305907 14759 tablet_bootstrap.cc:492] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2: Bootstrap starting.
I20260812 02:42:33.306522 14755 tablet_bootstrap.cc:492] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29: No bootstrap required, opened a new log
I20260812 02:42:33.306700 14755 ts_tablet_manager.cc:1397] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.001s
I20260812 02:42:33.307183 14755 raft_consensus.cc:348] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:33.307264 14759 tablet_bootstrap.cc:654] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:33.307312 14755 raft_consensus.cc:374] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:33.307374 14755 raft_consensus.cc:729] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3837eed94d364463a8c1612e8f184a29, State: Initialized, Role: FOLLOWER
I20260812 02:42:33.307566 14755 consensus_queue.cc:260] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:33.307978 14755 ts_tablet_manager.cc:1428] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 02:42:33.308724 14759 tablet_bootstrap.cc:492] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2: No bootstrap required, opened a new log
I20260812 02:42:33.308840 14759 ts_tablet_manager.cc:1397] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 02:42:33.309437 14759 raft_consensus.cc:348] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:33.309583 14759 raft_consensus.cc:374] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:33.309628 14759 raft_consensus.cc:729] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35216454ca59473da0299411c3b1e6e2, State: Initialized, Role: FOLLOWER
I20260812 02:42:33.309793 14759 consensus_queue.cc:260] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:33.310163 14759 ts_tablet_manager.cc:1428] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260812 02:42:33.325076 14762 raft_consensus.cc:482] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:42:33.325241 14762 raft_consensus.cc:504] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:33.326807 14762 leader_election.cc:288] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3837eed94d364463a8c1612e8f184a29 (127.10.75.66:46781), 35216454ca59473da0299411c3b1e6e2 (127.10.75.67:39331)
I20260812 02:42:33.331542 14767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:33.327186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:50955 (local address 127.10.75.66:46781)
0812 02:42:33.327509 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:33.327524 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:33.327670 (+ 146us) server_negotiation.cc:407] Connection header received
0812 02:42:33.327822 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:33.327826 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:33.327922 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:33.328030 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:33.328407 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.328996 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.330381 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.330832 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.330991 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:33.331063 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:33.331288 (+ 225us) server_negotiation.cc:299] Negotiation successful
0812 02:42:33.331372 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":106,"threads_started":1}
I20260812 02:42:33.331552 14768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:33.327231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:44721 (local address 127.10.75.67:39331)
0812 02:42:33.327606 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:33.327617 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:33.327811 (+ 194us) server_negotiation.cc:407] Connection header received
0812 02:42:33.327958 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:33.327965 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:33.328031 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:33.328112 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:33.328523 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.329051 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.330373 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.330846 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.330995 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:33.331061 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:33.331305 (+ 244us) server_negotiation.cc:299] Negotiation successful
0812 02:42:33.331411 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":138,"threads_started":1}
I20260812 02:42:33.331558 14764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:33.327022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:46781 (local address 127.10.75.65:50955)
0812 02:42:33.327506 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:33.327523 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:33.327683 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:33.328059 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:33.328062 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:33.328082 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:33.328268 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:33.328277 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.329116 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.329122 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:33.330251 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:33.330261 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.330984 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.330988 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:33.331145 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:33.331167 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 02:42:33.331262 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 02:42:33.331370 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"mutex_wait_us":109,"thread_start_us":183,"threads_started":1}
I20260812 02:42:33.331563 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:33.327100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:39331 (local address 127.10.75.65:44721)
0812 02:42:33.327703 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:33.327719 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:33.327837 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:33.328198 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:33.328204 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:33.328222 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:33.328389 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:33.328399 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.329165 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.329170 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:33.330249 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:33.330259 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.331004 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.331008 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:33.331168 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:33.331188 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 02:42:33.331280 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 02:42:33.331368 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"mutex_wait_us":85,"thread_start_us":137,"threads_started":1}
I20260812 02:42:33.332090 14439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f5a03b2ffc04843a7a4b01695c8e5b7" candidate_uuid: "1910b15781e5457487271de682c8fa5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35216454ca59473da0299411c3b1e6e2" is_pre_election: true
I20260812 02:42:33.332284 14439 raft_consensus.cc:2454] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1910b15781e5457487271de682c8fa5d in term 0.
I20260812 02:42:33.332732 14192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f5a03b2ffc04843a7a4b01695c8e5b7" candidate_uuid: "1910b15781e5457487271de682c8fa5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3837eed94d364463a8c1612e8f184a29" is_pre_election: true
I20260812 02:42:33.332823 13850 leader_election.cc:302] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1910b15781e5457487271de682c8fa5d, 35216454ca59473da0299411c3b1e6e2; no voters:
I20260812 02:42:33.332914 14192 raft_consensus.cc:2454] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1910b15781e5457487271de682c8fa5d in term 0.
I20260812 02:42:33.333206 14762 raft_consensus.cc:2781] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:42:33.333293 14762 raft_consensus.cc:482] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:42:33.333344 14762 raft_consensus.cc:3037] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:33.334697 14762 raft_consensus.cc:504] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:33.335124 14762 leader_election.cc:288] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [CANDIDATE]: Term 1 election: Requested vote from peers 3837eed94d364463a8c1612e8f184a29 (127.10.75.66:46781), 35216454ca59473da0299411c3b1e6e2 (127.10.75.67:39331)
I20260812 02:42:33.335515 14192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f5a03b2ffc04843a7a4b01695c8e5b7" candidate_uuid: "1910b15781e5457487271de682c8fa5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3837eed94d364463a8c1612e8f184a29"
I20260812 02:42:33.335541 14439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f5a03b2ffc04843a7a4b01695c8e5b7" candidate_uuid: "1910b15781e5457487271de682c8fa5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35216454ca59473da0299411c3b1e6e2"
I20260812 02:42:33.335656 14192 raft_consensus.cc:3037] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:33.335675 14439 raft_consensus.cc:3037] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:33.337078 14192 raft_consensus.cc:2454] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1910b15781e5457487271de682c8fa5d in term 1.
I20260812 02:42:33.337150 14439 raft_consensus.cc:2454] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1910b15781e5457487271de682c8fa5d in term 1.
I20260812 02:42:33.337401 13847 leader_election.cc:302] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1910b15781e5457487271de682c8fa5d, 3837eed94d364463a8c1612e8f184a29; no voters:
I20260812 02:42:33.337599 14762 raft_consensus.cc:2781] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:33.337877 14762 raft_consensus.cc:686] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [term 1 LEADER]: Becoming Leader. State: Replica: 1910b15781e5457487271de682c8fa5d, State: Running, Role: LEADER
I20260812 02:42:33.338248 14762 consensus_queue.cc:237] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:33.340967 13684 catalog_manager.cc:5495] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1910b15781e5457487271de682c8fa5d (127.10.75.65). New cstate: current_term: 1 leader_uuid: "1910b15781e5457487271de682c8fa5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260812 02:42:33.362287 14773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:33.358088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50254 (local address 127.10.75.65:37993)
0812 02:42:33.358388 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:33.358396 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:33.358409 (+ 13us) server_negotiation.cc:407] Connection header received
0812 02:42:33.358522 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:33.358525 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:33.358591 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:33.358720 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:42:33.358985 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.359676 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.360548 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.360783 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.360863 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:33.361117 (+ 254us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:42:33.361722 (+ 605us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:42:33.361819 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:33.361983 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 02:42:33.362052 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":130,"threads_started":1}
I20260812 02:42:33.374732 14767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:33.371165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:43621 (local address 127.10.75.66:46781)
0812 02:42:33.371317 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:33.371321 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:33.371353 (+ 32us) server_negotiation.cc:407] Connection header received
0812 02:42:33.371542 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:33.371545 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:33.371601 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:33.371669 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:42:33.371926 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.372521 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.373462 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.373685 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.373770 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:33.374229 (+ 459us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:42:33.374334 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:42:33.374406 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:33.374536 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 02:42:33.374592 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 02:42:33.374815 14777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:33.370869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:46781 (local address 127.10.75.65:43621)
0812 02:42:33.371280 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:33.371295 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:33.371430 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:33.371690 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:33.371693 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:33.371699 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 02:42:33.371827 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:33.371832 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.372620 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.372623 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:33.373346 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:33.373355 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.373788 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.373791 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:33.373915 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:33.374015 (+ 100us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 02:42:33.374431 (+ 416us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 02:42:33.374439 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 02:42:33.374514 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 02:42:33.374594 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":173,"threads_started":1}
I20260812 02:42:33.381695 14439 raft_consensus.cc:1261] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2 [term 1 FOLLOWER]: Refusing update from remote peer 1910b15781e5457487271de682c8fa5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:42:33.381705 14192 raft_consensus.cc:1261] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29 [term 1 FOLLOWER]: Refusing update from remote peer 1910b15781e5457487271de682c8fa5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:42:33.382303 14762 consensus_queue.cc:1035] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:33.382531 14769 consensus_queue.cc:1035] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:33.401839 14786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:33.397665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:37993 (local address 127.10.75.66:33095)
0812 02:42:33.398077 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:33.398095 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:33.398237 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:33.398586 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:33.398588 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:33.398596 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 02:42:33.398702 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:33.398707 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.399396 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.399399 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:33.400254 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:33.400266 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.400856 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.400859 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:33.400988 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:33.401019 (+ 31us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 02:42:33.401337 (+ 318us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 02:42:33.401347 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 02:42:33.401566 (+ 219us) client_negotiation.cc:240] Negotiation successful
0812 02:42:33.401675 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":121,"threads_started":1}
I20260812 02:42:33.401885 14773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:33.397758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:33095 (local address 127.10.75.65:37993)
0812 02:42:33.397911 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:33.397918 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:33.398184 (+ 266us) server_negotiation.cc:407] Connection header received
0812 02:42:33.398372 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:33.398375 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:33.398468 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:33.398550 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:42:33.398776 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.399310 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.400391 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.400725 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.400854 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:33.401151 (+ 297us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:42:33.401247 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:42:33.401333 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:33.401658 (+ 325us) server_negotiation.cc:299] Negotiation successful
0812 02:42:33.401744 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 02:42:33.430326 13687 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:42:33.430575 13687 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:42:33.433295 13687 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54: Sending DeleteTablet for 3 replicas of tablet 3f5a03b2ffc04843a7a4b01695c8e5b7
I20260812 02:42:33.433970 13927 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f5a03b2ffc04843a7a4b01695c8e5b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:33 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:50244
I20260812 02:42:33.434043 14151 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f5a03b2ffc04843a7a4b01695c8e5b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:33 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:38270
I20260812 02:42:33.434278 14733 tablet_replica.cc:330] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29: stopping tablet replica
I20260812 02:42:33.434279 14729 tablet_replica.cc:330] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d: stopping tablet replica
I20260812 02:42:33.434418 14729 raft_consensus.cc:2229] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:42:33.434425 14733 raft_consensus.cc:2229] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:42:33.434576 14733 raft_consensus.cc:2258] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:33.434824 14729 raft_consensus.cc:2258] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:33.434900 14411 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f5a03b2ffc04843a7a4b01695c8e5b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:33 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:35676
I20260812 02:42:33.435149 14732 tablet_replica.cc:330] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2: stopping tablet replica
I20260812 02:42:33.435312 14732 raft_consensus.cc:2229] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:42:33.435464 14732 raft_consensus.cc:2258] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:33.435693 14729 ts_tablet_manager.cc:1905] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:33.436321 14732 ts_tablet_manager.cc:1905] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:33.436287 13687 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37072:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:42:33.436784 13687 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:42:33.439342 14732 ts_tablet_manager.cc:1918] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 02:42:33.439375 14733 ts_tablet_manager.cc:1905] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:33.439422 14732 log.cc:1196] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/3f5a03b2ffc04843a7a4b01695c8e5b7
I20260812 02:42:33.439714 14732 ts_tablet_manager.cc:1939] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 35216454ca59473da0299411c3b1e6e2: Deleting consensus metadata
I20260812 02:42:33.440426 13664 catalog_manager.cc:4841] TS 35216454ca59473da0299411c3b1e6e2 (127.10.75.67:39331): tablet 3f5a03b2ffc04843a7a4b01695c8e5b7 (table test-table [id=fd3ced6de9984338863fb030464c67c8]) successfully deleted
I20260812 02:42:33.441748 14729 ts_tablet_manager.cc:1918] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 02:42:33.441828 14729 log.cc:1196] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-0/wal/wals/3f5a03b2ffc04843a7a4b01695c8e5b7
I20260812 02:42:33.442145 14729 ts_tablet_manager.cc:1939] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 1910b15781e5457487271de682c8fa5d: Deleting consensus metadata
I20260812 02:42:33.442605 14733 ts_tablet_manager.cc:1918] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 02:42:33.442677 14733 log.cc:1196] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/3f5a03b2ffc04843a7a4b01695c8e5b7
I20260812 02:42:33.443051 13927 tablet_service.cc:1467] Processing CreateTablet for tablet a1e073aa5de841f896addadf3b9b8463 (DEFAULT_TABLE table=test-table [id=6113802293354207b87c716bb292f634]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:33.443236 14733 ts_tablet_manager.cc:1939] T 3f5a03b2ffc04843a7a4b01695c8e5b7 P 3837eed94d364463a8c1612e8f184a29: Deleting consensus metadata
I20260812 02:42:33.443228 14151 tablet_service.cc:1467] Processing CreateTablet for tablet a1e073aa5de841f896addadf3b9b8463 (DEFAULT_TABLE table=test-table [id=6113802293354207b87c716bb292f634]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:33.443354 13927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1e073aa5de841f896addadf3b9b8463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:33.443508 14151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1e073aa5de841f896addadf3b9b8463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:33.443986 13659 catalog_manager.cc:4841] TS 3837eed94d364463a8c1612e8f184a29 (127.10.75.66:46781): tablet 3f5a03b2ffc04843a7a4b01695c8e5b7 (table test-table [id=fd3ced6de9984338863fb030464c67c8]) successfully deleted
I20260812 02:42:33.445230 14411 tablet_service.cc:1467] Processing CreateTablet for tablet a1e073aa5de841f896addadf3b9b8463 (DEFAULT_TABLE table=test-table [id=6113802293354207b87c716bb292f634]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:33.445493 14411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1e073aa5de841f896addadf3b9b8463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:33.445741 14753 tablet_bootstrap.cc:492] T a1e073aa5de841f896addadf3b9b8463 P 1910b15781e5457487271de682c8fa5d: Bootstrap starting.
I20260812 02:42:33.445890 14755 tablet_bootstrap.cc:492] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29: Bootstrap starting.
I20260812 02:42:33.446164 13666 catalog_manager.cc:4841] TS 1910b15781e5457487271de682c8fa5d (127.10.75.65:37993): tablet 3f5a03b2ffc04843a7a4b01695c8e5b7 (table test-table [id=fd3ced6de9984338863fb030464c67c8]) successfully deleted
I20260812 02:42:33.446861 14755 tablet_bootstrap.cc:654] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:33.447117 14753 tablet_bootstrap.cc:654] T a1e073aa5de841f896addadf3b9b8463 P 1910b15781e5457487271de682c8fa5d: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:33.448063 14759 tablet_bootstrap.cc:492] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2: Bootstrap starting.
I20260812 02:42:33.448972 14759 tablet_bootstrap.cc:654] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:33.449079 14755 tablet_bootstrap.cc:492] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29: No bootstrap required, opened a new log
I20260812 02:42:33.449169 14755 ts_tablet_manager.cc:1397] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 02:42:33.449503 14753 tablet_bootstrap.cc:492] T a1e073aa5de841f896addadf3b9b8463 P 1910b15781e5457487271de682c8fa5d: No bootstrap required, opened a new log
I20260812 02:42:33.449585 14753 ts_tablet_manager.cc:1397] T a1e073aa5de841f896addadf3b9b8463 P 1910b15781e5457487271de682c8fa5d: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 02:42:33.449605 14755 raft_consensus.cc:348] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:33.449733 14755 raft_consensus.cc:374] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:33.449764 14755 raft_consensus.cc:729] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3837eed94d364463a8c1612e8f184a29, State: Initialized, Role: FOLLOWER
I20260812 02:42:33.449911 14755 consensus_queue.cc:260] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:33.450103 14759 tablet_bootstrap.cc:492] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2: No bootstrap required, opened a new log
I20260812 02:42:33.450095 14753 raft_consensus.cc:348] T a1e073aa5de841f896addadf3b9b8463 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:33.450186 14759 ts_tablet_manager.cc:1397] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260812 02:42:33.450202 14753 raft_consensus.cc:374] T a1e073aa5de841f896addadf3b9b8463 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:33.450237 14753 raft_consensus.cc:729] T a1e073aa5de841f896addadf3b9b8463 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1910b15781e5457487271de682c8fa5d, State: Initialized, Role: FOLLOWER
I20260812 02:42:33.450243 14755 ts_tablet_manager.cc:1428] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 02:42:33.450371 14753 consensus_queue.cc:260] T a1e073aa5de841f896addadf3b9b8463 P 1910b15781e5457487271de682c8fa5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:33.450590 14759 raft_consensus.cc:348] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:33.450702 14759 raft_consensus.cc:374] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:33.450732 14759 raft_consensus.cc:729] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35216454ca59473da0299411c3b1e6e2, State: Initialized, Role: FOLLOWER
I20260812 02:42:33.450866 14759 consensus_queue.cc:260] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:33.451130 14759 ts_tablet_manager.cc:1428] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 02:42:33.451355 14753 ts_tablet_manager.cc:1428] T a1e073aa5de841f896addadf3b9b8463 P 1910b15781e5457487271de682c8fa5d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 02:42:33.636101 14715 raft_consensus.cc:482] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:42:33.636322 14715 raft_consensus.cc:504] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:33.636839 14715 leader_election.cc:288] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1910b15781e5457487271de682c8fa5d (127.10.75.65:37993), 3837eed94d364463a8c1612e8f184a29 (127.10.75.66:46781)
I20260812 02:42:33.637569 13959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1e073aa5de841f896addadf3b9b8463" candidate_uuid: "35216454ca59473da0299411c3b1e6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1910b15781e5457487271de682c8fa5d" is_pre_election: true
I20260812 02:42:33.637831 13959 raft_consensus.cc:2454] T a1e073aa5de841f896addadf3b9b8463 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35216454ca59473da0299411c3b1e6e2 in term 0.
I20260812 02:42:33.637835 14192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1e073aa5de841f896addadf3b9b8463" candidate_uuid: "35216454ca59473da0299411c3b1e6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3837eed94d364463a8c1612e8f184a29" is_pre_election: true
I20260812 02:42:33.638029 14192 raft_consensus.cc:2454] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35216454ca59473da0299411c3b1e6e2 in term 0.
I20260812 02:42:33.638345 14329 leader_election.cc:302] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1910b15781e5457487271de682c8fa5d, 35216454ca59473da0299411c3b1e6e2; no voters:
I20260812 02:42:33.638655 14715 raft_consensus.cc:2781] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:42:33.638723 14715 raft_consensus.cc:482] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:42:33.638764 14715 raft_consensus.cc:3037] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:33.640060 14715 raft_consensus.cc:504] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:33.640462 14715 leader_election.cc:288] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [CANDIDATE]: Term 1 election: Requested vote from peers 1910b15781e5457487271de682c8fa5d (127.10.75.65:37993), 3837eed94d364463a8c1612e8f184a29 (127.10.75.66:46781)
I20260812 02:42:33.640933 14192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1e073aa5de841f896addadf3b9b8463" candidate_uuid: "35216454ca59473da0299411c3b1e6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3837eed94d364463a8c1612e8f184a29"
I20260812 02:42:33.640987 13959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1e073aa5de841f896addadf3b9b8463" candidate_uuid: "35216454ca59473da0299411c3b1e6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1910b15781e5457487271de682c8fa5d"
I20260812 02:42:33.641106 13959 raft_consensus.cc:3037] T a1e073aa5de841f896addadf3b9b8463 P 1910b15781e5457487271de682c8fa5d [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:33.641108 14192 raft_consensus.cc:3037] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:33.642625 13959 raft_consensus.cc:2454] T a1e073aa5de841f896addadf3b9b8463 P 1910b15781e5457487271de682c8fa5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35216454ca59473da0299411c3b1e6e2 in term 1.
I20260812 02:42:33.642625 14192 raft_consensus.cc:2454] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35216454ca59473da0299411c3b1e6e2 in term 1.
I20260812 02:42:33.643013 14329 leader_election.cc:302] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1910b15781e5457487271de682c8fa5d, 35216454ca59473da0299411c3b1e6e2, 3837eed94d364463a8c1612e8f184a29; no voters:
I20260812 02:42:33.643256 14715 raft_consensus.cc:2781] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:33.643461 14715 raft_consensus.cc:686] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 35216454ca59473da0299411c3b1e6e2, State: Running, Role: LEADER
I20260812 02:42:33.643622 14715 consensus_queue.cc:237] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } }
I20260812 02:42:33.645686 13684 catalog_manager.cc:5495] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35216454ca59473da0299411c3b1e6e2 (127.10.75.67). New cstate: current_term: 1 leader_uuid: "35216454ca59473da0299411c3b1e6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35216454ca59473da0299411c3b1e6e2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 39331 } health_report { overall_health: HEALTHY } } }
I20260812 02:42:33.705471 14768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:33.701948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35692 (local address 127.10.75.67:39331)
0812 02:42:33.702123 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:33.702129 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:33.702175 (+ 46us) server_negotiation.cc:407] Connection header received
0812 02:42:33.702364 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:33.702367 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:33.702420 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:33.702506 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:42:33.702789 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.703364 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.704247 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:33.704481 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:33.704601 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:33.704928 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:42:33.705060 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:42:33.705146 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:33.705253 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 02:42:33.705322 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 02:42:33.712580 14192 raft_consensus.cc:1261] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29 [term 1 FOLLOWER]: Refusing update from remote peer 35216454ca59473da0299411c3b1e6e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:42:33.713006 13959 raft_consensus.cc:1261] T a1e073aa5de841f896addadf3b9b8463 P 1910b15781e5457487271de682c8fa5d [term 1 FOLLOWER]: Refusing update from remote peer 35216454ca59473da0299411c3b1e6e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:42:33.713040 14715 consensus_queue.cc:1035] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3837eed94d364463a8c1612e8f184a29" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:33.713404 14715 consensus_queue.cc:1035] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1910b15781e5457487271de682c8fa5d" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 02:42:33.727144 14699 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 02:42:35.281533 13687 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:42:35.281752 13687 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:42:35.284821 13687 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c0302d24d654f018a3c27c6876fff54: Sending DeleteTablet for 3 replicas of tablet a1e073aa5de841f896addadf3b9b8463
I20260812 02:42:35.285532 14152 tablet_service.cc:1514] Processing DeleteTablet for tablet a1e073aa5de841f896addadf3b9b8463 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:35 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:38270
I20260812 02:42:35.285519 13927 tablet_service.cc:1514] Processing DeleteTablet for tablet a1e073aa5de841f896addadf3b9b8463 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:35 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:50244
I20260812 02:42:35.285655 14411 tablet_service.cc:1514] Processing DeleteTablet for tablet a1e073aa5de841f896addadf3b9b8463 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:35 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:35676
I20260812 02:42:35.286036 14853 tablet_replica.cc:330] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2: stopping tablet replica
I20260812 02:42:35.286214 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 13820
I20260812 02:42:35.286242 14853 raft_consensus.cc:2229] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:42:35.324803 14853 raft_consensus.cc:2258] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:35.325932 14853 ts_tablet_manager.cc:1905] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:35.327157 14850 tablet_replica.cc:330] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29: stopping tablet replica
I20260812 02:42:35.327381 14850 raft_consensus.cc:2229] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:42:35.327562 14850 raft_consensus.cc:2258] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:35.328487 14850 ts_tablet_manager.cc:1905] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:35.329246 14853 ts_tablet_manager.cc:1918] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 02:42:35.329360 14853 log.cc:1196] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/a1e073aa5de841f896addadf3b9b8463
I20260812 02:42:35.329705 14853 ts_tablet_manager.cc:1939] T a1e073aa5de841f896addadf3b9b8463 P 35216454ca59473da0299411c3b1e6e2: Deleting consensus metadata
I20260812 02:42:35.330708 13664 catalog_manager.cc:4841] TS 35216454ca59473da0299411c3b1e6e2 (127.10.75.67:39331): tablet a1e073aa5de841f896addadf3b9b8463 (table test-table [id=6113802293354207b87c716bb292f634]) successfully deleted
I20260812 02:42:35.332333 14850 ts_tablet_manager.cc:1918] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 02:42:35.332427 14850 log.cc:1196] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/a1e073aa5de841f896addadf3b9b8463
I20260812 02:42:35.332756 14850 ts_tablet_manager.cc:1939] T a1e073aa5de841f896addadf3b9b8463 P 3837eed94d364463a8c1612e8f184a29: Deleting consensus metadata
I20260812 02:42:35.333666 13659 catalog_manager.cc:4841] TS 3837eed94d364463a8c1612e8f184a29 (127.10.75.66:46781): tablet a1e073aa5de841f896addadf3b9b8463 (table test-table [id=6113802293354207b87c716bb292f634]) successfully deleted
W20260812 02:42:35.337561 13666 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.75.65:37993 (error 108)
I20260812 02:42:35.338686 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 14053
I20260812 02:42:35.339239 14855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:35.338617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:37993 (local address 127.0.0.1:50262)
0812 02:42:35.338951 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:35.339063 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.65:37993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":80,"threads_started":1}
W20260812 02:42:35.343915 13666 catalog_manager.cc:4584] TS 1910b15781e5457487271de682c8fa5d (127.10.75.65:37993): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a1e073aa5de841f896addadf3b9b8463: Network error: Client connection negotiation failed: client connection to 127.10.75.65:37993: connect: Connection refused (error 111)
I20260812 02:42:35.362779 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 14289
I20260812 02:42:35.377049 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 13626
2026-08-12T02:42:35Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (7122 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:42:35 dist-test-slave-2p8l krb5kdc[14859](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:42:35 dist-test-slave-2p8l krb5kdc[14859](info): set up 2 sockets
Aug 12 02:42:35 dist-test-slave-2p8l krb5kdc[14859](info): commencing operation
krb5kdc: starting...
W20260812 02:42:36.710264 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.294s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:42:36 dist-test-slave-2p8l krb5kdc[14859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:42:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:42:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:42:36.837937 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:35965
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:38015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:35965
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:36.952493 14881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:36.952782 14881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:36.952823 14881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:36.956861 14881 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:42:36.956923 14881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:36.956943 14881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:36.956961 14881 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:42:36.956976 14881 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:42:36.962203 14881 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:38015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:35965
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:35965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:36.963219 14881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:36.964285 14881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:36.973424 14887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:36.973464 14881 server_base.cc:1034] running on GCE node
W20260812 02:42:36.973448 14888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:36.973424 14893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:36.974452 14881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:36.975733 14881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:36.976912 14881 hybrid_clock.cc:648] HybridClock initialized: now 1786502556976883 us; error 43 us; skew 500 ppm
Aug 12 02:42:36 dist-test-slave-2p8l krb5kdc[14859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502556, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:36.979839 14881 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:42:36.980715 14881 webserver.cc:460] Webserver started at http://127.10.75.126:35233/ using document root <none> and password file <none>
I20260812 02:42:36.981276 14881 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:36.981338 14881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:36.981570 14881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:36.983686 14881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "7c98542a3f084e3583678488d570e4e6"
format_stamp: "Formatted at 2026-08-12 02:42:36 on dist-test-slave-2p8l"
server_key: "3d4092693fc6055319fb512401a258c6"
server_key_iv: "c4e0543462a561585f9ff9019ccff32b"
server_key_version: "encryptionkey@0"
I20260812 02:42:36.984275 14881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "7c98542a3f084e3583678488d570e4e6"
format_stamp: "Formatted at 2026-08-12 02:42:36 on dist-test-slave-2p8l"
server_key: "3d4092693fc6055319fb512401a258c6"
server_key_iv: "c4e0543462a561585f9ff9019ccff32b"
server_key_version: "encryptionkey@0"
I20260812 02:42:36.988190 14881 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 02:42:36.990731 14905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:36.991963 14881 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:36.992127 14881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "7c98542a3f084e3583678488d570e4e6"
format_stamp: "Formatted at 2026-08-12 02:42:36 on dist-test-slave-2p8l"
server_key: "3d4092693fc6055319fb512401a258c6"
server_key_iv: "c4e0543462a561585f9ff9019ccff32b"
server_key_version: "encryptionkey@0"
I20260812 02:42:36.992242 14881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:37.003475 14881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:37.006677 14881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:37.006876 14881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:37.014171 14881 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:35965
I20260812 02:42:37.014184 15015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:35965 every 8 connection(s)
I20260812 02:42:37.015110 14881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:42:37.017865 15016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:37.023389 15016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6: Bootstrap starting.
I20260812 02:42:37.024488 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 14881
I20260812 02:42:37.024641 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:42:37.024923 10541 external_mini_cluster.cc:1428] Setting key 176ab84315ec2f7933d17b0e2b8872ec
I20260812 02:42:37.025976 15016 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:37.026892 15016 log.cc:824] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:37.029110 15016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6: No bootstrap required, opened a new log
I20260812 02:42:37.033629 15016 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c98542a3f084e3583678488d570e4e6" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35965 } }
I20260812 02:42:37.033890 15016 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:37.033977 15016 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c98542a3f084e3583678488d570e4e6, State: Initialized, Role: FOLLOWER
I20260812 02:42:37.034456 15016 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c98542a3f084e3583678488d570e4e6" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35965 } }
Aug 12 02:42:37 dist-test-slave-2p8l krb5kdc[14859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:37.034626 15016 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:42:37.034719 15016 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:42:37.034832 15016 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:37.036223 15016 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c98542a3f084e3583678488d570e4e6" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35965 } }
I20260812 02:42:37.036645 15016 leader_election.cc:302] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c98542a3f084e3583678488d570e4e6; no voters:
I20260812 02:42:37.036998 15016 leader_election.cc:288] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:42:37.037137 15023 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:37.037367 15023 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6 [term 1 LEADER]: Becoming Leader. State: Replica: 7c98542a3f084e3583678488d570e4e6, State: Running, Role: LEADER
I20260812 02:42:37.037725 15023 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c98542a3f084e3583678488d570e4e6" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35965 } }
I20260812 02:42:37.038466 15016 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:42:37.039379 15027 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c98542a3f084e3583678488d570e4e6. Latest consensus state: current_term: 1 leader_uuid: "7c98542a3f084e3583678488d570e4e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c98542a3f084e3583678488d570e4e6" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35965 } } }
I20260812 02:42:37.039518 15027 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:37.039858 15026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c98542a3f084e3583678488d570e4e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c98542a3f084e3583678488d570e4e6" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35965 } } }
I20260812 02:42:37.039947 15026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:37.040860 15039 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:42:37.041567 15021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:37.026191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44908 (local address 127.10.75.126:35965)
0812 02:42:37.026664 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:37.026685 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:37.026728 (+ 43us) server_negotiation.cc:407] Connection header received
0812 02:42:37.027522 (+ 794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:37.027542 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:37.027953 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:37.028318 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:37.029054 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:37.030545 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:37.031444 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:37.032246 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:37.032454 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:37.035207 (+ 2753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:37.035214 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:37.035231 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:37.035261 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:37.037280 (+ 2019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:37.037817 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:37.037823 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:37.037829 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:37.037964 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:37.038343 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:37.038347 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:37.038348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:37.038857 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:37.039820 (+ 963us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:37.039980 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 02:42:37.040325 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":141,"threads_started":1}
I20260812 02:42:37.044099 15039 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:42:37.049847 15039 catalog_manager.cc:1347] Generated new cluster ID: 55774149a50a4d0eb0138256ae6e2d89
I20260812 02:42:37.049906 15039 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:42:37.062160 15039 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:42:37.063169 15039 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:42:37.069595 15039 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c98542a3f084e3583678488d570e4e6: Generated new TSK 0
I20260812 02:42:37.070428 15039 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
I20260812 02:42:37.108969 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35965
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:38015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:37.255195 15058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:37.255455 15058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:37.255497 15058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:37.259436 15058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:37.259490 15058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:37.259549 15058 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:42:37.264642 15058 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:38015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35965
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:37.265611 15058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:37.266605 15058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:37.275959 15077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:37.275992 15078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:37.276067 15084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:37.276582 15058 server_base.cc:1034] running on GCE node
I20260812 02:42:37.276975 15058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:37.277637 15058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:37.278826 15058 hybrid_clock.cc:648] HybridClock initialized: now 1786502557278812 us; error 24 us; skew 500 ppm
Aug 12 02:42:37 dist-test-slave-2p8l krb5kdc[14859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502557, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:37.281553 15058 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:42:37.282521 15058 webserver.cc:460] Webserver started at http://127.10.75.65:44233/ using document root <none> and password file <none>
I20260812 02:42:37.283075 15058 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:37.283169 15058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:37.283404 15058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:37.285378 15058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "e45af24abde14168b033e0fa547888c3"
format_stamp: "Formatted at 2026-08-12 02:42:37 on dist-test-slave-2p8l"
server_key: "81da47f7ac3a7bcb4b466db0cd4a61e7"
server_key_iv: "5c1dd7d3af2fb9d6b43ceaf46282fcd6"
server_key_version: "encryptionkey@0"
I20260812 02:42:37.285964 15058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "e45af24abde14168b033e0fa547888c3"
format_stamp: "Formatted at 2026-08-12 02:42:37 on dist-test-slave-2p8l"
server_key: "81da47f7ac3a7bcb4b466db0cd4a61e7"
server_key_iv: "5c1dd7d3af2fb9d6b43ceaf46282fcd6"
server_key_version: "encryptionkey@0"
I20260812 02:42:37.289650 15058 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 02:42:37.292156 15096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:37.293330 15058 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260812 02:42:37.293478 15058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "e45af24abde14168b033e0fa547888c3"
format_stamp: "Formatted at 2026-08-12 02:42:37 on dist-test-slave-2p8l"
server_key: "81da47f7ac3a7bcb4b466db0cd4a61e7"
server_key_iv: "5c1dd7d3af2fb9d6b43ceaf46282fcd6"
server_key_version: "encryptionkey@0"
I20260812 02:42:37.293593 15058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:37.312600 15058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:37.315647 15058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:37.315851 15058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:37.316442 15058 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:37.317278 15058 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:37.317353 15058 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:37.317426 15058 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:37.317471 15058 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:37.327333 15058 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:43801
I20260812 02:42:37.327373 15310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:43801 every 8 connection(s)
I20260812 02:42:37.328186 15058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
Aug 12 02:42:37 dist-test-slave-2p8l krb5kdc[14859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502557, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:37.337688 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 15058
I20260812 02:42:37.337822 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:42:37.338201 10541 external_mini_cluster.cc:1428] Setting key abf06ddd861051e1616c479ae7604bcd
I20260812 02:42:37.342962 15021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:37.330024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:34247 (local address 127.10.75.126:35965)
0812 02:42:37.330185 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:37.330192 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:37.331222 (+ 1030us) server_negotiation.cc:407] Connection header received
0812 02:42:37.332072 (+ 850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:37.332075 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:37.332127 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:37.332215 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:37.333339 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:37.333899 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:37.335152 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:37.335415 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:37.335568 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:37.338334 (+ 2766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:37.338338 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:37.338341 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:37.338425 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:37.340345 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:37.341018 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:37.341021 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:37.341022 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:37.341099 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:37.341574 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:37.341577 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:37.341579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:37.341766 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:37.341848 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:37.342599 (+ 751us) server_negotiation.cc:299] Negotiation successful
0812 02:42:37.342747 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 02:42:37.344048 15314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:37.330401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35965 (local address 127.10.75.65:34247)
0812 02:42:37.331089 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:37.331130 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:37.331863 (+ 733us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:37.332368 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:37.332374 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:37.332709 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:37.333172 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:37.333185 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:37.334045 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:37.334048 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:37.334995 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:37.335014 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:37.335615 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:37.335619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:37.335800 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:37.336351 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:37.336367 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:37.338148 (+ 1781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:37.340462 (+ 2314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:37.340472 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:37.340490 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:37.340904 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:37.341192 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:37.341199 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:37.341204 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:37.341422 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:37.341880 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:37.341890 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:37.342287 (+ 397us) client_negotiation.cc:769] Sending connection context
0812 02:42:37.342492 (+ 205us) client_negotiation.cc:240] Negotiation successful
0812 02:42:37.342903 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":120,"threads_started":1}
I20260812 02:42:37.345378 15311 heartbeater.cc:347] Connected to a master server at 127.10.75.126:35965
I20260812 02:42:37.345623 15311 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:37.346187 15311 heartbeater.cc:511] Master 127.10.75.126:35965 requested a full tablet report, sending...
I20260812 02:42:37.347692 14948 ts_manager.cc:194] Registered new tserver with Master: e45af24abde14168b033e0fa547888c3 (127.10.75.65:43801)
I20260812 02:42:37.348814 14948 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:34247
WARNING: no policy specified for kudu/127.10.75.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
I20260812 02:42:37.368471 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35965
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:38015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:37.484061 15318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:37.484349 15318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:37.484428 15318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:37.488719 15318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:37.488806 15318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:37.488894 15318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:42:37.493968 15318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:38015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35965
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:37.495002 15318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:37.496012 15318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:37.505781 15328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:37.505833 15318 server_base.cc:1034] running on GCE node
W20260812 02:42:37.505883 15327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:37.505990 15331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:37.506430 15318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:37.507078 15318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:37.508250 15318 hybrid_clock.cc:648] HybridClock initialized: now 1786502557508222 us; error 39 us; skew 500 ppm
Aug 12 02:42:37 dist-test-slave-2p8l krb5kdc[14859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502557, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:37.511097 15318 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:42:37.511880 15318 webserver.cc:460] Webserver started at http://127.10.75.66:41729/ using document root <none> and password file <none>
I20260812 02:42:37.512439 15318 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:37.512506 15318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:37.512715 15318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:37.515005 15318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "21dc6e63ec47446ca8b4f9ca0f6d2a16"
format_stamp: "Formatted at 2026-08-12 02:42:37 on dist-test-slave-2p8l"
server_key: "73cd0ef2c27fbaabd993ce7064a628a8"
server_key_iv: "5c68f13ce57356c1dccb3d130d66388f"
server_key_version: "encryptionkey@0"
I20260812 02:42:37.515599 15318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "21dc6e63ec47446ca8b4f9ca0f6d2a16"
format_stamp: "Formatted at 2026-08-12 02:42:37 on dist-test-slave-2p8l"
server_key: "73cd0ef2c27fbaabd993ce7064a628a8"
server_key_iv: "5c68f13ce57356c1dccb3d130d66388f"
server_key_version: "encryptionkey@0"
I20260812 02:42:37.519640 15318 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 02:42:37.522168 15344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:37.523351 15318 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:37.523490 15318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "21dc6e63ec47446ca8b4f9ca0f6d2a16"
format_stamp: "Formatted at 2026-08-12 02:42:37 on dist-test-slave-2p8l"
server_key: "73cd0ef2c27fbaabd993ce7064a628a8"
server_key_iv: "5c68f13ce57356c1dccb3d130d66388f"
server_key_version: "encryptionkey@0"
I20260812 02:42:37.523605 15318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:37.545262 15318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:37.548264 15318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:37.548465 15318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:37.549078 15318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:37.549896 15318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:37.549976 15318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:37.550091 15318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:37.550148 15318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:37.561601 15318 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:42435
I20260812 02:42:37.561642 15550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:42435 every 8 connection(s)
I20260812 02:42:37.562572 15318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:42:37.567008 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 15318
I20260812 02:42:37.567135 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:42:37.567415 10541 external_mini_cluster.cc:1428] Setting key 59e724d8e8559081f3b9e45a4e8c0282
Aug 12 02:42:37 dist-test-slave-2p8l krb5kdc[14859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502557, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:37.577214 15021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:37.564438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:41623 (local address 127.10.75.126:35965)
0812 02:42:37.564636 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:37.564640 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:37.565557 (+ 917us) server_negotiation.cc:407] Connection header received
0812 02:42:37.566569 (+ 1012us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:37.566573 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:37.566641 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:37.566738 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:37.568135 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:37.568868 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:37.570371 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:37.570605 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:37.570724 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:37.573525 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:37.573528 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:37.573530 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:37.573553 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:37.575074 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:37.575605 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:37.575609 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:37.575610 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:37.575696 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:37.576065 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:37.576068 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:37.576070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:37.576249 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:37.576381 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:37.576895 (+ 514us) server_negotiation.cc:299] Negotiation successful
0812 02:42:37.577027 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
WARNING: no policy specified for kudu/127.10.75.67@KRBTEST.COM; defaulting to no policy
I20260812 02:42:37.578007 15555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:37.564742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35965 (local address 127.10.75.66:41623)
0812 02:42:37.565397 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:37.565439 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:37.566342 (+ 903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:37.566918 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:37.566924 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:37.567392 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:37.567927 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:37.567945 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:37.569046 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:37.569049 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:37.570243 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:37.570254 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:37.570764 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:37.570769 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:37.570938 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:37.571634 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:37.571650 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:37.573346 (+ 1696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:37.575202 (+ 1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:37.575208 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:37.575222 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:37.575493 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:37.575796 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:37.575800 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:37.575802 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:37.575950 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:37.576381 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:37.576388 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:37.576628 (+ 240us) client_negotiation.cc:769] Sending connection context
0812 02:42:37.576842 (+ 214us) client_negotiation.cc:240] Negotiation successful
0812 02:42:37.577161 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":111,"threads_started":1}
I20260812 02:42:37.579299 15551 heartbeater.cc:347] Connected to a master server at 127.10.75.126:35965
I20260812 02:42:37.579560 15551 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:37.580111 15551 heartbeater.cc:511] Master 127.10.75.126:35965 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.67@KRBTEST.COM" created.
I20260812 02:42:37.581236 14948 ts_manager.cc:194] Registered new tserver with Master: 21dc6e63ec47446ca8b4f9ca0f6d2a16 (127.10.75.66:42435)
I20260812 02:42:37.582106 14948 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:41623
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
I20260812 02:42:37.596714 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35965
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:38015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:37.710798 15561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:37.711017 15561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:37.711057 15561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:37.715044 15561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:37.715098 15561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:37.715181 15561 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:42:37.720248 15561 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:38015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35965
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:37.721189 15561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:37.722237 15561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 02:42:37.731686 15561 server_base.cc:1034] running on GCE node
W20260812 02:42:37.731644 15570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:37.731664 15571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:37.731645 15573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:37.732331 15561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:37.732969 15561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:37.734138 15561 hybrid_clock.cc:648] HybridClock initialized: now 1786502557734116 us; error 32 us; skew 500 ppm
Aug 12 02:42:37 dist-test-slave-2p8l krb5kdc[14859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502557, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:37.736850 15561 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:42:37.737684 15561 webserver.cc:460] Webserver started at http://127.10.75.67:44267/ using document root <none> and password file <none>
I20260812 02:42:37.738241 15561 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:37.738308 15561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:37.738477 15561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:37.740864 15561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "486622413aff4967ae58eaab80af0907"
format_stamp: "Formatted at 2026-08-12 02:42:37 on dist-test-slave-2p8l"
server_key: "db8250fee5c4081f350bfd6e0bfefc1b"
server_key_iv: "ecf4595c11e1f0e6cd44cab8448a09e1"
server_key_version: "encryptionkey@0"
I20260812 02:42:37.741415 15561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "486622413aff4967ae58eaab80af0907"
format_stamp: "Formatted at 2026-08-12 02:42:37 on dist-test-slave-2p8l"
server_key: "db8250fee5c4081f350bfd6e0bfefc1b"
server_key_iv: "ecf4595c11e1f0e6cd44cab8448a09e1"
server_key_version: "encryptionkey@0"
I20260812 02:42:37.745000 15561 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260812 02:42:37.747323 15585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:37.748463 15561 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:42:37.748605 15561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "486622413aff4967ae58eaab80af0907"
format_stamp: "Formatted at 2026-08-12 02:42:37 on dist-test-slave-2p8l"
server_key: "db8250fee5c4081f350bfd6e0bfefc1b"
server_key_iv: "ecf4595c11e1f0e6cd44cab8448a09e1"
server_key_version: "encryptionkey@0"
I20260812 02:42:37.748701 15561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:37.760974 15561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:37.763813 15561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:37.764015 15561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:37.764595 15561 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:37.765367 15561 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:37.765414 15561 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:37.765481 15561 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:37.765514 15561 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:37.774646 15561 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:34699
I20260812 02:42:37.774712 15797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:34699 every 8 connection(s)
I20260812 02:42:37.775473 15561 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:42:37.783381 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 15561
I20260812 02:42:37.783560 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:42:37.783845 10541 external_mini_cluster.cc:1428] Setting key f1a87ad4cfee22351f21d74421d4d631
Aug 12 02:42:37 dist-test-slave-2p8l krb5kdc[14859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502557, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:37.788941 15021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:37.777330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:46171 (local address 127.10.75.126:35965)
0812 02:42:37.777482 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:37.777486 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:37.778480 (+ 994us) server_negotiation.cc:407] Connection header received
0812 02:42:37.779397 (+ 917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:37.779400 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:37.779459 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:37.779568 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:37.780681 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:37.781236 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:37.782463 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:37.782691 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:37.782807 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:37.785664 (+ 2857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:37.785668 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:37.785670 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:37.785702 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:37.787181 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:37.787674 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:37.787676 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:37.787678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:37.787755 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:37.788038 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:37.788053 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:37.788055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:37.788211 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:37.788286 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:37.788731 (+ 445us) server_negotiation.cc:299] Negotiation successful
0812 02:42:37.788825 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 02:42:37.789777 15800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:37.777647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35965 (local address 127.10.75.67:46171)
0812 02:42:37.778335 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:37.778377 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:37.779179 (+ 802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:37.779730 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:37.779736 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:37.780064 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:37.780517 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:37.780530 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:37.781371 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:37.781375 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:37.782336 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:37.782346 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:37.782846 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:37.782850 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:37.783011 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:37.783617 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:37.783662 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:37.785499 (+ 1837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:37.787303 (+ 1804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:37.787308 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:37.787318 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:37.787575 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:37.787835 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:37.787837 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:37.787839 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:37.787960 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:37.788299 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:37.788303 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:37.788501 (+ 198us) client_negotiation.cc:769] Sending connection context
0812 02:42:37.788682 (+ 181us) client_negotiation.cc:240] Negotiation successful
0812 02:42:37.788904 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":109,"threads_started":1}
I20260812 02:42:37.790807 15798 heartbeater.cc:347] Connected to a master server at 127.10.75.126:35965
I20260812 02:42:37.791031 15798 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:37.791492 15798 heartbeater.cc:511] Master 127.10.75.126:35965 requested a full tablet report, sending...
I20260812 02:42:37.792479 14948 ts_manager.cc:194] Registered new tserver with Master: 486622413aff4967ae58eaab80af0907 (127.10.75.67:34699)
I20260812 02:42:37.793038 14948 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:46171
I20260812 02:42:37.797992 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 02:42:37.813076 15021 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:42:37.811728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44920 (local address 127.10.75.126:35965)
0812 02:42:37.811915 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:37.811919 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:37.811993 (+ 74us) server_negotiation.cc:407] Connection header received
0812 02:42:37.812098 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:37.812101 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:37.812149 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:37.812217 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:37.812920 (+ 703us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44920: BlockingRecv error: recv got EOF from 127.0.0.1:44920 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
I20260812 02:42:37.814810 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 15058
I20260812 02:42:37.834617 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 15318
I20260812 02:42:37.843672 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 15561
I20260812 02:42:37.852298 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 14881
2026-08-12T02:42:37Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2464 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:42:37 dist-test-slave-2p8l krb5kdc[15821](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:42:37 dist-test-slave-2p8l krb5kdc[15821](info): set up 2 sockets
Aug 12 02:42:37 dist-test-slave-2p8l krb5kdc[15821](info): commencing operation
krb5kdc: starting...
W20260812 02:42:39.187757 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.308s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:42:39 dist-test-slave-2p8l krb5kdc[15821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:42:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:42:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:42:39.312736 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:42739
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:35605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:42739
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:39.421911 15842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:39.422219 15842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:39.422309 15842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:39.426249 15842 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:42:39.426330 15842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:39.426371 15842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:39.426407 15842 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:42:39.426440 15842 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:42:39.431465 15842 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:35605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:42739
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:42739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15842
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:39.432476 15842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:39.433501 15842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:39.441814 15863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:39.441820 15860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:39.441968 15842 server_base.cc:1034] running on GCE node
W20260812 02:42:39.441778 15859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:39.442907 15842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:39.443944 15842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:39.445145 15842 hybrid_clock.cc:648] HybridClock initialized: now 1786502559445107 us; error 46 us; skew 500 ppm
Aug 12 02:42:39 dist-test-slave-2p8l krb5kdc[15821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502559, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:39.448132 15842 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:42:39.449062 15842 webserver.cc:460] Webserver started at http://127.10.75.126:35739/ using document root <none> and password file <none>
I20260812 02:42:39.449643 15842 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:39.449712 15842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:39.449970 15842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:39.452139 15842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "92f24e257b3f41e4bb220faa79fcdbb2"
format_stamp: "Formatted at 2026-08-12 02:42:39 on dist-test-slave-2p8l"
server_key: "9748baf106f2859e8c0fa4050114970d"
server_key_iv: "f116c393611d1fcebc937b9f95fd4efc"
server_key_version: "encryptionkey@0"
I20260812 02:42:39.452749 15842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "92f24e257b3f41e4bb220faa79fcdbb2"
format_stamp: "Formatted at 2026-08-12 02:42:39 on dist-test-slave-2p8l"
server_key: "9748baf106f2859e8c0fa4050114970d"
server_key_iv: "f116c393611d1fcebc937b9f95fd4efc"
server_key_version: "encryptionkey@0"
I20260812 02:42:39.456655 15842 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 02:42:39.459161 15876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:39.460389 15842 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:42:39.460534 15842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "92f24e257b3f41e4bb220faa79fcdbb2"
format_stamp: "Formatted at 2026-08-12 02:42:39 on dist-test-slave-2p8l"
server_key: "9748baf106f2859e8c0fa4050114970d"
server_key_iv: "f116c393611d1fcebc937b9f95fd4efc"
server_key_version: "encryptionkey@0"
I20260812 02:42:39.460651 15842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:39.480799 15842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:39.483891 15842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:39.484117 15842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:39.491210 15842 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:42739
I20260812 02:42:39.491506 15972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:42739 every 8 connection(s)
I20260812 02:42:39.492146 15842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:42:39.494867 15977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:39.498386 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 15842
I20260812 02:42:39.498574 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:42:39.498869 10541 external_mini_cluster.cc:1428] Setting key bd6290db2cd8afb4a6258e2f2b3ebd27
I20260812 02:42:39.500588 15977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2: Bootstrap starting.
I20260812 02:42:39.503036 15977 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:39.503779 15977 log.cc:824] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:39.505971 15977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2: No bootstrap required, opened a new log
Aug 12 02:42:39 dist-test-slave-2p8l krb5kdc[15821](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:39.510577 15977 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92f24e257b3f41e4bb220faa79fcdbb2" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42739 } }
I20260812 02:42:39.510872 15977 raft_consensus.cc:374] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:39.510942 15977 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92f24e257b3f41e4bb220faa79fcdbb2, State: Initialized, Role: FOLLOWER
I20260812 02:42:39.511404 15977 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92f24e257b3f41e4bb220faa79fcdbb2" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42739 } }
I20260812 02:42:39.511607 15977 raft_consensus.cc:388] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:42:39.511686 15977 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:42:39.511809 15977 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:39.512732 15977 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92f24e257b3f41e4bb220faa79fcdbb2" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42739 } }
I20260812 02:42:39.513156 15977 leader_election.cc:302] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92f24e257b3f41e4bb220faa79fcdbb2; no voters:
I20260812 02:42:39.513567 15977 leader_election.cc:288] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:42:39.513659 15987 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:39.513896 15987 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2 [term 1 LEADER]: Becoming Leader. State: Replica: 92f24e257b3f41e4bb220faa79fcdbb2, State: Running, Role: LEADER
I20260812 02:42:39.514127 15984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:39.500191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59772 (local address 127.10.75.126:42739)
0812 02:42:39.500668 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:39.500694 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:39.500746 (+ 52us) server_negotiation.cc:407] Connection header received
0812 02:42:39.501421 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:39.501438 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:39.501776 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:39.502122 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:39.503043 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:39.504289 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:39.505233 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:39.505986 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:39.506216 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:39.508622 (+ 2406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:39.508630 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:39.508651 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:39.508697 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:39.510909 (+ 2212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:39.511509 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:39.511516 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:39.511522 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:39.511682 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:39.512034 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:39.512037 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:39.512039 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:39.512429 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:39.512639 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:39.512951 (+ 312us) server_negotiation.cc:299] Negotiation successful
0812 02:42:39.513228 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":149,"threads_started":1}
I20260812 02:42:39.514286 15987 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92f24e257b3f41e4bb220faa79fcdbb2" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42739 } }
I20260812 02:42:39.514889 15977 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:42:39.516788 15991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92f24e257b3f41e4bb220faa79fcdbb2. Latest consensus state: current_term: 1 leader_uuid: "92f24e257b3f41e4bb220faa79fcdbb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92f24e257b3f41e4bb220faa79fcdbb2" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42739 } } }
I20260812 02:42:39.516906 15988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "92f24e257b3f41e4bb220faa79fcdbb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92f24e257b3f41e4bb220faa79fcdbb2" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42739 } } }
I20260812 02:42:39.517016 15988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:39.516919 15991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:39.517598 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:42:39.517555 16009 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:42:39.521402 16009 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:42:39.527427 16009 catalog_manager.cc:1347] Generated new cluster ID: 387c5610f5a64434971b82bf6b0f648d
I20260812 02:42:39.527549 16009 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:42:39.541342 15984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:39.535545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59784 (local address 127.10.75.126:42739)
0812 02:42:39.535650 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:39.535655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:39.535948 (+ 293us) server_negotiation.cc:407] Connection header received
0812 02:42:39.536066 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:39.536070 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:39.536123 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:39.536212 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:39.536796 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:39.537642 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:39.538872 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:39.539255 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:39.539350 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:39.540282 (+ 932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:39.540286 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:39.540289 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:42:39.540853 (+ 564us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:39.540886 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:42:39.540906 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:39.540994 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:39.541139 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 02:42:39.541201 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 02:42:39.553293 16009 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:42:39.554522 16009 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:42:39.563587 16009 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 92f24e257b3f41e4bb220faa79fcdbb2: Generated new TSK 0
I20260812 02:42:39.564303 16009 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:42:39.577587 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 15842
2026-08-12T02:42:39Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1726 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:42:39 dist-test-slave-2p8l krb5kdc[16031](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:42:39 dist-test-slave-2p8l krb5kdc[16031](info): set up 2 sockets
Aug 12 02:42:39 dist-test-slave-2p8l krb5kdc[16031](info): commencing operation
krb5kdc: starting...
W20260812 02:42:40.883477 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.276s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:42:40 dist-test-slave-2p8l krb5kdc[16031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:42:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:42:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:42:41.008904 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:36857
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:43353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:36857
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:41.123431 16048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:41.123698 16048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:41.123739 16048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:41.127771 16048 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:42:41.127826 16048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:41.127846 16048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:41.127862 16048 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:42:41.127877 16048 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:42:41.132927 16048 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:43353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:36857
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:36857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16048
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:41.133867 16048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:41.134915 16048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:41.142923 16059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:41.142920 16058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:41.143133 16048 server_base.cc:1034] running on GCE node
W20260812 02:42:41.142920 16061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:41.143800 16048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:41.144855 16048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:41.146019 16048 hybrid_clock.cc:648] HybridClock initialized: now 1786502561146000 us; error 29 us; skew 500 ppm
Aug 12 02:42:41 dist-test-slave-2p8l krb5kdc[16031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502561, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:41.153120 16048 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:42:41.154292 16048 webserver.cc:460] Webserver started at http://127.10.75.126:43681/ using document root <none> and password file <none>
I20260812 02:42:41.154856 16048 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:41.154920 16048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:41.155081 16048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:41.157035 16048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "26bf579f92714741b4289303426fe2b5"
format_stamp: "Formatted at 2026-08-12 02:42:41 on dist-test-slave-2p8l"
server_key: "a0940a7e8e3e22e84a8eb07f341960bb"
server_key_iv: "168ef41607fc2603f268382205b38adc"
server_key_version: "encryptionkey@0"
I20260812 02:42:41.157548 16048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "26bf579f92714741b4289303426fe2b5"
format_stamp: "Formatted at 2026-08-12 02:42:41 on dist-test-slave-2p8l"
server_key: "a0940a7e8e3e22e84a8eb07f341960bb"
server_key_iv: "168ef41607fc2603f268382205b38adc"
server_key_version: "encryptionkey@0"
I20260812 02:42:41.161043 16048 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260812 02:42:41.163375 16082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:41.164625 16048 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:42:41.164746 16048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "26bf579f92714741b4289303426fe2b5"
format_stamp: "Formatted at 2026-08-12 02:42:41 on dist-test-slave-2p8l"
server_key: "a0940a7e8e3e22e84a8eb07f341960bb"
server_key_iv: "168ef41607fc2603f268382205b38adc"
server_key_version: "encryptionkey@0"
I20260812 02:42:41.164849 16048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:41.189821 16048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:41.193063 16048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:41.193276 16048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:41.200157 16048 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:36857
I20260812 02:42:41.200547 16181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:36857 every 8 connection(s)
I20260812 02:42:41.201097 16048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:42:41.203872 16186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:41.205262 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 16048
I20260812 02:42:41.205399 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:42:41.205698 10541 external_mini_cluster.cc:1428] Setting key 8abe2054a41408c260a49a551e334a91
I20260812 02:42:41.210233 16186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5: Bootstrap starting.
I20260812 02:42:41.212394 16186 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:41.213111 16186 log.cc:824] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5: Log is configured to *not* fsync() on all Append() calls
Aug 12 02:42:41 dist-test-slave-2p8l krb5kdc[16031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:41.215144 16186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5: No bootstrap required, opened a new log
I20260812 02:42:41.219012 16186 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26bf579f92714741b4289303426fe2b5" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36857 } }
I20260812 02:42:41.219183 16189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:41.206986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37684 (local address 127.10.75.126:36857)
0812 02:42:41.207395 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:41.207427 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:41.207471 (+ 44us) server_negotiation.cc:407] Connection header received
0812 02:42:41.208103 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:41.208119 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:41.208431 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:41.208751 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:41.209580 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:41.210620 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:41.211462 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:41.211906 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:41.212071 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:41.214549 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:41.214554 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:41.214566 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:41.214591 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:41.216328 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:41.216812 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:41.216817 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:41.216822 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:41.216927 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:41.217245 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:41.217250 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:41.217251 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:41.217659 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:41.217877 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:41.218187 (+ 310us) server_negotiation.cc:299] Negotiation successful
0812 02:42:41.218453 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":137,"threads_started":1}
I20260812 02:42:41.219261 16186 raft_consensus.cc:374] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:41.219327 16186 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26bf579f92714741b4289303426fe2b5, State: Initialized, Role: FOLLOWER
I20260812 02:42:41.219853 16186 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26bf579f92714741b4289303426fe2b5" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36857 } }
I20260812 02:42:41.220026 16186 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:42:41.220091 16186 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:42:41.220187 16186 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:41.221091 16186 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26bf579f92714741b4289303426fe2b5" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36857 } }
I20260812 02:42:41.221484 16186 leader_election.cc:302] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26bf579f92714741b4289303426fe2b5; no voters:
I20260812 02:42:41.221861 16186 leader_election.cc:288] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:42:41.222007 16191 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:41.222289 16191 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5 [term 1 LEADER]: Becoming Leader. State: Replica: 26bf579f92714741b4289303426fe2b5, State: Running, Role: LEADER
I20260812 02:42:41.222630 16191 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26bf579f92714741b4289303426fe2b5" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36857 } }
I20260812 02:42:41.223124 16186 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:42:41.224328 16193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26bf579f92714741b4289303426fe2b5. Latest consensus state: current_term: 1 leader_uuid: "26bf579f92714741b4289303426fe2b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26bf579f92714741b4289303426fe2b5" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36857 } } }
I20260812 02:42:41.224329 16192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26bf579f92714741b4289303426fe2b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26bf579f92714741b4289303426fe2b5" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36857 } } }
I20260812 02:42:41.224552 16192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:41.224542 16193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:41.225009 16204 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:42:41.228485 16204 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:42:41.234352 16204 catalog_manager.cc:1347] Generated new cluster ID: b5d4a4f95b4141079ca85ac434e5943a
I20260812 02:42:41.234427 16204 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:42:41.254616 16204 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:42:41.255499 16204 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:42:41.262457 16204 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 26bf579f92714741b4289303426fe2b5: Generated new TSK 0
I20260812 02:42:41.263094 16204 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
I20260812 02:42:41.296566 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:36857
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:43353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:41.407191 16224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:41.407428 16224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:41.407470 16224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:41.411451 16224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:41.411502 16224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:41.411586 16224 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:42:41.416623 16224 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:43353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:36857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16224
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:41.417577 16224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:41.418659 16224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:41.428225 16242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:41.428217 16240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:41.428215 16246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:41.428586 16224 server_base.cc:1034] running on GCE node
I20260812 02:42:41.428951 16224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:41.429545 16224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:41.430728 16224 hybrid_clock.cc:648] HybridClock initialized: now 1786502561430695 us; error 45 us; skew 500 ppm
Aug 12 02:42:41 dist-test-slave-2p8l krb5kdc[16031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502561, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:41.433775 16224 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:42:41.434695 16224 webserver.cc:460] Webserver started at http://127.10.75.65:33491/ using document root <none> and password file <none>
I20260812 02:42:41.435248 16224 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:41.435343 16224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:41.435588 16224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:41.437602 16224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "307423a633d849d0ac5bb8c7407ea700"
format_stamp: "Formatted at 2026-08-12 02:42:41 on dist-test-slave-2p8l"
server_key: "af908e84ae3a11f4c1e478d8965d6680"
server_key_iv: "7de7070842bfc03b9703dba5094a3608"
server_key_version: "encryptionkey@0"
I20260812 02:42:41.438278 16224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "307423a633d849d0ac5bb8c7407ea700"
format_stamp: "Formatted at 2026-08-12 02:42:41 on dist-test-slave-2p8l"
server_key: "af908e84ae3a11f4c1e478d8965d6680"
server_key_iv: "7de7070842bfc03b9703dba5094a3608"
server_key_version: "encryptionkey@0"
I20260812 02:42:41.441947 16224 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:42:41.444411 16262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:41.445762 16224 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:42:41.445892 16224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "307423a633d849d0ac5bb8c7407ea700"
format_stamp: "Formatted at 2026-08-12 02:42:41 on dist-test-slave-2p8l"
server_key: "af908e84ae3a11f4c1e478d8965d6680"
server_key_iv: "7de7070842bfc03b9703dba5094a3608"
server_key_version: "encryptionkey@0"
I20260812 02:42:41.445999 16224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:41.471971 16224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:41.475134 16224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:41.475409 16224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:41.476016 16224 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:41.476848 16224 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:41.476897 16224 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:41.476969 16224 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:41.476999 16224 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:41.486004 16224 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:34387
I20260812 02:42:41.486122 16460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:34387 every 8 connection(s)
I20260812 02:42:41.486951 16224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:42:41.493140 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 16224
I20260812 02:42:41.493242 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:42:41.493614 10541 external_mini_cluster.cc:1428] Setting key 85baa4ae84103bdeebce52f2bc774caa
Aug 12 02:42:41 dist-test-slave-2p8l krb5kdc[16031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502561, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:41.501929 16189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:41.488951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:59515 (local address 127.10.75.126:36857)
0812 02:42:41.489131 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:41.489136 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:41.489959 (+ 823us) server_negotiation.cc:407] Connection header received
0812 02:42:41.491382 (+ 1423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:41.491385 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:41.491433 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:41.491511 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:41.492700 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:41.493317 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:41.494794 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:41.495157 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:41.495274 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:41.497694 (+ 2420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:41.497700 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:41.497705 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:41.497739 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:41.499365 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:41.500010 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:41.500014 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:41.500016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:41.500099 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:41.500552 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:41.500556 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:41.500559 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:41.500777 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:41.500860 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:41.501531 (+ 671us) server_negotiation.cc:299] Negotiation successful
0812 02:42:41.501688 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 02:42:41.502581 16463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:41.489319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:36857 (local address 127.10.75.65:59515)
0812 02:42:41.489790 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:41.489838 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:41.491183 (+ 1345us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:41.491710 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:41.491717 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:41.492080 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:41.492559 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:41.492573 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:41.493461 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:41.493465 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:41.494641 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:41.494652 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:41.495317 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:41.495320 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:41.495457 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:41.496081 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:41.496097 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:41.497523 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:41.499494 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:41.499503 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:41.499519 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:41.499903 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:41.500214 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:41.500221 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:41.500226 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:41.500431 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:41.500898 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:41.500906 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:41.501237 (+ 331us) client_negotiation.cc:769] Sending connection context
0812 02:42:41.501438 (+ 201us) client_negotiation.cc:240] Negotiation successful
0812 02:42:41.501694 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":110,"threads_started":1}
I20260812 02:42:41.503891 16461 heartbeater.cc:347] Connected to a master server at 127.10.75.126:36857
I20260812 02:42:41.504168 16461 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:41.504812 16461 heartbeater.cc:511] Master 127.10.75.126:36857 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.75.66@KRBTEST.COM; defaulting to no policy
I20260812 02:42:41.506669 16109 ts_manager.cc:194] Registered new tserver with Master: 307423a633d849d0ac5bb8c7407ea700 (127.10.75.65:34387)
I20260812 02:42:41.507929 16109 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:59515
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
I20260812 02:42:41.524655 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:36857
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:43353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:41.633582 16469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:41.633811 16469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:41.633852 16469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:41.637887 16469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:41.637943 16469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:41.638032 16469 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:42:41.643139 16469 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:43353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:36857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16469
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:41.644121 16469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:41.645136 16469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:41.655807 16477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:41.655798 16483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:41.655907 16469 server_base.cc:1034] running on GCE node
W20260812 02:42:41.655798 16476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:41.656375 16469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:41.656960 16469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:41.658145 16469 hybrid_clock.cc:648] HybridClock initialized: now 1786502561658114 us; error 42 us; skew 500 ppm
Aug 12 02:42:41 dist-test-slave-2p8l krb5kdc[16031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502561, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:41.660779 16469 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:42:41.661588 16469 webserver.cc:460] Webserver started at http://127.10.75.66:46679/ using document root <none> and password file <none>
I20260812 02:42:41.662200 16469 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:41.662294 16469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:41.662521 16469 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:41.664559 16469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "88e9cf75373b43f697933721de4ce512"
format_stamp: "Formatted at 2026-08-12 02:42:41 on dist-test-slave-2p8l"
server_key: "f2c5779bf96a5a8c0967fed77365dc6c"
server_key_iv: "cd958066bac0f906f347f49d34e974a1"
server_key_version: "encryptionkey@0"
I20260812 02:42:41.665144 16469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "88e9cf75373b43f697933721de4ce512"
format_stamp: "Formatted at 2026-08-12 02:42:41 on dist-test-slave-2p8l"
server_key: "f2c5779bf96a5a8c0967fed77365dc6c"
server_key_iv: "cd958066bac0f906f347f49d34e974a1"
server_key_version: "encryptionkey@0"
I20260812 02:42:41.668848 16469 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260812 02:42:41.671293 16502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:41.672436 16469 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:42:41.672572 16469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "88e9cf75373b43f697933721de4ce512"
format_stamp: "Formatted at 2026-08-12 02:42:41 on dist-test-slave-2p8l"
server_key: "f2c5779bf96a5a8c0967fed77365dc6c"
server_key_iv: "cd958066bac0f906f347f49d34e974a1"
server_key_version: "encryptionkey@0"
I20260812 02:42:41.672678 16469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:41.688215 16469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:41.691133 16469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:41.691349 16469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:41.691905 16469 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:41.692646 16469 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:41.692694 16469 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:41.692732 16469 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:41.692756 16469 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:41.701624 16469 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:41285
I20260812 02:42:41.701663 16708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:41285 every 8 connection(s)
I20260812 02:42:41.702543 16469 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:42:41.711164 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 16469
I20260812 02:42:41.711330 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:42:41.711621 10541 external_mini_cluster.cc:1428] Setting key d8ef5db1d34070a6234dd4fd594ff646
Aug 12 02:42:41 dist-test-slave-2p8l krb5kdc[16031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502561, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:41.717285 16189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:41.704292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:55929 (local address 127.10.75.126:36857)
0812 02:42:41.704463 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:41.704469 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:41.705294 (+ 825us) server_negotiation.cc:407] Connection header received
0812 02:42:41.706695 (+ 1401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:41.706698 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:41.706745 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:41.706820 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:41.707928 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:41.708438 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:41.709568 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:41.709798 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:41.709894 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:41.712633 (+ 2739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:41.712636 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:41.712638 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:41.712678 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:41.715176 (+ 2498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:41.715736 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:41.715741 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:41.715743 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:41.715829 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:41.716181 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:41.716185 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:41.716187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:41.716373 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:41.716486 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:41.716983 (+ 497us) server_negotiation.cc:299] Negotiation successful
0812 02:42:41.717112 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 02:42:41.718225 16713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:41.704686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:36857 (local address 127.10.75.66:55929)
0812 02:42:41.705138 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:41.705179 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:41.706493 (+ 1314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:41.707014 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:41.707020 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:41.707356 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:41.707798 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:41.707810 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:41.708544 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:41.708547 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:41.709389 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:41.709398 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:41.709973 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:41.709976 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:41.710204 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:41.710809 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:41.710826 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:41.712457 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:41.715297 (+ 2840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:41.715303 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:41.715317 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:41.715622 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:41.715927 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:41.715930 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:41.715932 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:41.716079 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:41.716486 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:41.716494 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:41.716736 (+ 242us) client_negotiation.cc:769] Sending connection context
0812 02:42:41.716925 (+ 189us) client_negotiation.cc:240] Negotiation successful
0812 02:42:41.717239 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":113,"threads_started":1}
I20260812 02:42:41.719810 16710 heartbeater.cc:347] Connected to a master server at 127.10.75.126:36857
I20260812 02:42:41.720048 16710 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:41.720520 16710 heartbeater.cc:511] Master 127.10.75.126:36857 requested a full tablet report, sending...
I20260812 02:42:41.721575 16109 ts_manager.cc:194] Registered new tserver with Master: 88e9cf75373b43f697933721de4ce512 (127.10.75.66:41285)
WARNING: no policy specified for kudu/127.10.75.67@KRBTEST.COM; defaulting to no policy
I20260812 02:42:41.722229 16109 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:55929
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
I20260812 02:42:41.741107 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:36857
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:43353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:41.853214 16718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:41.853452 16718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:41.853492 16718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:41.857378 16718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:41.857426 16718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:41.857481 16718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:42:41.862442 16718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:43353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:36857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:41.863318 16718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:41.864204 16718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:41.873507 16725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:41.873525 16726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:41.873531 16728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:41.873800 16718 server_base.cc:1034] running on GCE node
I20260812 02:42:41.874373 16718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:41.874970 16718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:41.876123 16718 hybrid_clock.cc:648] HybridClock initialized: now 1786502561876093 us; error 41 us; skew 500 ppm
Aug 12 02:42:41 dist-test-slave-2p8l krb5kdc[16031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502561, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:41.878911 16718 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:42:41.879747 16718 webserver.cc:460] Webserver started at http://127.10.75.67:39989/ using document root <none> and password file <none>
I20260812 02:42:41.880282 16718 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:41.880373 16718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:41.880592 16718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:41.882581 16718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "90cf0afb50e94321810b8339b4c65d9d"
format_stamp: "Formatted at 2026-08-12 02:42:41 on dist-test-slave-2p8l"
server_key: "4bec9fa96e58f9187a03f5977cd3b4d7"
server_key_iv: "b26d5c5002bbb76e7e16004bedbf55e1"
server_key_version: "encryptionkey@0"
I20260812 02:42:41.883121 16718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "90cf0afb50e94321810b8339b4c65d9d"
format_stamp: "Formatted at 2026-08-12 02:42:41 on dist-test-slave-2p8l"
server_key: "4bec9fa96e58f9187a03f5977cd3b4d7"
server_key_iv: "b26d5c5002bbb76e7e16004bedbf55e1"
server_key_version: "encryptionkey@0"
I20260812 02:42:41.886612 16718 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 02:42:41.888988 16737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:41.890254 16718 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:41.890383 16718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "90cf0afb50e94321810b8339b4c65d9d"
format_stamp: "Formatted at 2026-08-12 02:42:41 on dist-test-slave-2p8l"
server_key: "4bec9fa96e58f9187a03f5977cd3b4d7"
server_key_iv: "b26d5c5002bbb76e7e16004bedbf55e1"
server_key_version: "encryptionkey@0"
I20260812 02:42:41.890489 16718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:41.907838 16718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:41.911516 16718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:41.911744 16718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:41.912535 16718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:41.913589 16718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:41.913636 16718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:41.913714 16718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:41.913745 16718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:41.922590 16718 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:39761
I20260812 02:42:41.922616 16944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:39761 every 8 connection(s)
I20260812 02:42:41.923673 16718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:42:41.927768 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 16718
I20260812 02:42:41.927870 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:42:41.928150 10541 external_mini_cluster.cc:1428] Setting key 61c6b5834472d3325029dfbd56f99efd
Aug 12 02:42:41 dist-test-slave-2p8l krb5kdc[16031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502561, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:41.937245 16189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:41.925633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:45853 (local address 127.10.75.126:36857)
0812 02:42:41.925783 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:41.925787 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:41.926638 (+ 851us) server_negotiation.cc:407] Connection header received
0812 02:42:41.928017 (+ 1379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:41.928021 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:41.928082 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:41.928179 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:41.929664 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:41.930306 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:41.931391 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:41.931596 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:41.931687 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:41.934021 (+ 2334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:41.934024 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:41.934026 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:41.934049 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:41.935529 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:41.935976 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:41.935982 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:41.935984 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:41.936056 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:41.936355 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:41.936357 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:41.936358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:41.936520 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:41.936592 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:41.937015 (+ 423us) server_negotiation.cc:299] Negotiation successful
0812 02:42:41.937104 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 02:42:41.938031 16947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:41.925986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:36857 (local address 127.10.75.67:45853)
0812 02:42:41.926488 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:41.926531 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:41.927732 (+ 1201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:41.928347 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:41.928353 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:41.928862 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:41.929508 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:41.929525 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:41.930433 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:41.930435 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:41.931288 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:41.931297 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:41.931741 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:41.931744 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:41.931882 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:41.932392 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:41.932408 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:41.933872 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:41.935633 (+ 1761us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:41.935639 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:41.935650 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:41.935891 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:41.936145 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:41.936147 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:41.936149 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:41.936275 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:41.936604 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:41.936608 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:41.936816 (+ 208us) client_negotiation.cc:769] Sending connection context
0812 02:42:41.936967 (+ 151us) client_negotiation.cc:240] Negotiation successful
0812 02:42:41.937228 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":117,"threads_started":1}
I20260812 02:42:41.939172 16945 heartbeater.cc:347] Connected to a master server at 127.10.75.126:36857
I20260812 02:42:41.939368 16945 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:41.939801 16945 heartbeater.cc:511] Master 127.10.75.126:36857 requested a full tablet report, sending...
I20260812 02:42:41.940821 16109 ts_manager.cc:194] Registered new tserver with Master: 90cf0afb50e94321810b8339b4c65d9d (127.10.75.67:39761)
I20260812 02:42:41.941397 16109 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:45853
I20260812 02:42:41.942003 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 02:42:41 dist-test-slave-2p8l krb5kdc[16031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502561, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 12 02:42:41 dist-test-slave-2p8l krb5kdc[16031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502561, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:41.969715 16189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:41.960806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37686 (local address 127.10.75.126:36857)
0812 02:42:41.960968 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:41.960972 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:41.961038 (+ 66us) server_negotiation.cc:407] Connection header received
0812 02:42:41.961211 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:41.961214 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:41.961261 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:41.961340 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:41.962166 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:41.962695 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:41.963577 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:41.963794 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:41.963872 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:41.966440 (+ 2568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:41.966443 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:41.966445 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:41.966468 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:41.967950 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:41.968375 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:41.968378 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:41.968379 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:41.968460 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:41.968740 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:41.968742 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:41.968743 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:41.968964 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:41.969123 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:41.969436 (+ 313us) server_negotiation.cc:299] Negotiation successful
0812 02:42:41.969536 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260812 02:42:41.970225 16107 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:37686
I20260812 02:42:41.971380 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 16224
I20260812 02:42:41.992983 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 16469
I20260812 02:42:42.005625 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 16718
I20260812 02:42:42.016434 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 16048
2026-08-12T02:42:42Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2438 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:42:42 dist-test-slave-2p8l krb5kdc[16964](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:42:42 dist-test-slave-2p8l krb5kdc[16964](info): set up 2 sockets
Aug 12 02:42:42 dist-test-slave-2p8l krb5kdc[16964](info): commencing operation
krb5kdc: starting...
W20260812 02:42:43.435222 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.390s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260812 02:42:43.771894 10541 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.337s user 0.001s sys 0.002s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260812 02:42:43.923166 10541 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.151s user 0.000s sys 0.003s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260812 02:42:44.106732 10541 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.183s user 0.000s sys 0.003s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/test-user.keytab.
W20260812 02:42:44.727203 10541 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.620s user 0.000s sys 0.003s
Aug 12 02:42:44 dist-test-slave-2p8l krb5kdc[16964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:42:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:42:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
W20260812 02:42:44.950557 10541 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.10.75.126: real 0.193s user 0.003s sys 0.003s
I20260812 02:42:44.951282 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:43575
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:43575
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:45.091457 16985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:45.091802 16985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:45.091847 16985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:45.095918 16985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:42:45.095988 16985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:45.096007 16985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:45.096025 16985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:42:45.096041 16985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:42:45.101809 16985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:43575
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:43575
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:45.103199 16985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:45.104453 16985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:45.115087 17004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:45.115080 17001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:45.115211 17008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:45.115795 16985 server_base.cc:1034] running on GCE node
I20260812 02:42:45.116554 16985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:45.118129 16985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:45.119326 16985 hybrid_clock.cc:648] HybridClock initialized: now 1786502565119299 us; error 48 us; skew 500 ppm
Aug 12 02:42:45 dist-test-slave-2p8l krb5kdc[16964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502565, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:45.122838 16985 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:42:45.123921 16985 webserver.cc:460] Webserver started at http://127.10.75.126:37543/ using document root <none> and password file <none>
I20260812 02:42:45.124643 16985 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:45.124747 16985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:45.125029 16985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:45.127735 16985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "842cd426f6824dd2a25ed2c391d4bc42"
format_stamp: "Formatted at 2026-08-12 02:42:45 on dist-test-slave-2p8l"
server_key: "8df9175df9bba97b6f4be1c7d9dcfff2"
server_key_iv: "e6a6a40326e684e365d6d31302035abb"
server_key_version: "encryptionkey@0"
I20260812 02:42:45.128468 16985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "842cd426f6824dd2a25ed2c391d4bc42"
format_stamp: "Formatted at 2026-08-12 02:42:45 on dist-test-slave-2p8l"
server_key: "8df9175df9bba97b6f4be1c7d9dcfff2"
server_key_iv: "e6a6a40326e684e365d6d31302035abb"
server_key_version: "encryptionkey@0"
I20260812 02:42:45.133117 16985 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 02:42:45.136019 17017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:45.137619 16985 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 02:42:45.137832 16985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "842cd426f6824dd2a25ed2c391d4bc42"
format_stamp: "Formatted at 2026-08-12 02:42:45 on dist-test-slave-2p8l"
server_key: "8df9175df9bba97b6f4be1c7d9dcfff2"
server_key_iv: "e6a6a40326e684e365d6d31302035abb"
server_key_version: "encryptionkey@0"
I20260812 02:42:45.137987 16985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:45.157299 16985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:45.160956 16985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:45.161198 16985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:45.169247 16985 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:43575
I20260812 02:42:45.169271 17109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:43575 every 8 connection(s)
I20260812 02:42:45.170405 16985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:42:45.171327 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 16985
I20260812 02:42:45.171474 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:42:45.171782 10541 external_mini_cluster.cc:1428] Setting key a7d33d77d39183514561cbedf3f6d5d8
I20260812 02:42:45.174175 17115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:45.180792 17115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42: Bootstrap starting.
Aug 12 02:42:45 dist-test-slave-2p8l krb5kdc[16964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:45.183876 17115 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:45.184827 17115 log.cc:824] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:45.187275 17123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:45.173445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51956 (local address 127.10.75.126:43575)
0812 02:42:45.173949 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:45.173964 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:45.174003 (+ 39us) server_negotiation.cc:407] Connection header received
0812 02:42:45.174803 (+ 800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:45.174823 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:45.175168 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:45.175527 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:45.176390 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:45.177424 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:45.178372 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:45.178854 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:45.179044 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:45.182246 (+ 3202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:45.182251 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:45.182265 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:45.182293 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:45.184146 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:45.184688 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:45.184694 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:45.184699 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:45.184813 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:45.185121 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:45.185124 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:45.185125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:45.185709 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:45.185883 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:45.186267 (+ 384us) server_negotiation.cc:299] Negotiation successful
0812 02:42:45.186502 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":176,"threads_started":1}
I20260812 02:42:45.187292 17115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42: No bootstrap required, opened a new log
I20260812 02:42:45.191457 17115 raft_consensus.cc:348] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "842cd426f6824dd2a25ed2c391d4bc42" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43575 } }
I20260812 02:42:45.191690 17115 raft_consensus.cc:374] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:45.191753 17115 raft_consensus.cc:729] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 842cd426f6824dd2a25ed2c391d4bc42, State: Initialized, Role: FOLLOWER
I20260812 02:42:45.192178 17115 consensus_queue.cc:260] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "842cd426f6824dd2a25ed2c391d4bc42" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43575 } }
I20260812 02:42:45.192320 17115 raft_consensus.cc:388] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:42:45.192384 17115 raft_consensus.cc:482] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:42:45.192512 17115 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:45.193442 17115 raft_consensus.cc:504] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "842cd426f6824dd2a25ed2c391d4bc42" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43575 } }
I20260812 02:42:45.193792 17115 leader_election.cc:302] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 842cd426f6824dd2a25ed2c391d4bc42; no voters:
I20260812 02:42:45.194169 17115 leader_election.cc:288] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:42:45.194321 17127 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:45.194581 17127 raft_consensus.cc:686] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42 [term 1 LEADER]: Becoming Leader. State: Replica: 842cd426f6824dd2a25ed2c391d4bc42, State: Running, Role: LEADER
I20260812 02:42:45.194916 17127 consensus_queue.cc:237] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "842cd426f6824dd2a25ed2c391d4bc42" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43575 } }
I20260812 02:42:45.195528 17115 sys_catalog.cc:564] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:42:45.196759 17132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 842cd426f6824dd2a25ed2c391d4bc42. Latest consensus state: current_term: 1 leader_uuid: "842cd426f6824dd2a25ed2c391d4bc42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "842cd426f6824dd2a25ed2c391d4bc42" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43575 } } }
I20260812 02:42:45.196889 17132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:45.197082 17128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "842cd426f6824dd2a25ed2c391d4bc42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "842cd426f6824dd2a25ed2c391d4bc42" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43575 } } }
I20260812 02:42:45.197263 17128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:45.197393 17140 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:42:45.200934 17140 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:42:45.209646 17140 catalog_manager.cc:1347] Generated new cluster ID: cfa9d031f6774d6c887823847b8c2d67
I20260812 02:42:45.209719 17140 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:42:45.229790 17140 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:42:45.231089 17140 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:42:45.241441 17140 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 842cd426f6824dd2a25ed2c391d4bc42: Generated new TSK 0
I20260812 02:42:45.242324 17140 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
I20260812 02:42:45.273988 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43575
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:45.391654 17164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:45.391922 17164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:45.391999 17164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:45.396080 17164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:45.396149 17164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:45.396236 17164 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:42:45.401664 17164 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43575
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:45.402727 17164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:45.403792 17164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:45.413501 17180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:45.413655 17164 server_base.cc:1034] running on GCE node
W20260812 02:42:45.413509 17175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:45.413842 17177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:45.414326 17164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:45.414969 17164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:45.416170 17164 hybrid_clock.cc:648] HybridClock initialized: now 1786502565416151 us; error 30 us; skew 500 ppm
Aug 12 02:42:45 dist-test-slave-2p8l krb5kdc[16964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502565, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:45.419143 17164 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:42:45.420120 17164 webserver.cc:460] Webserver started at http://127.10.75.65:42959/ using document root <none> and password file <none>
I20260812 02:42:45.420701 17164 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:45.420791 17164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:45.421027 17164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:45.423411 17164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "47d5406a480e4276aa920bff97bf88c4"
format_stamp: "Formatted at 2026-08-12 02:42:45 on dist-test-slave-2p8l"
server_key: "3116f6e9ebc354b6e67d4c574f83b2b9"
server_key_iv: "71e028d95f9b638286953ac54f4d808c"
server_key_version: "encryptionkey@0"
I20260812 02:42:45.424044 17164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "47d5406a480e4276aa920bff97bf88c4"
format_stamp: "Formatted at 2026-08-12 02:42:45 on dist-test-slave-2p8l"
server_key: "3116f6e9ebc354b6e67d4c574f83b2b9"
server_key_iv: "71e028d95f9b638286953ac54f4d808c"
server_key_version: "encryptionkey@0"
I20260812 02:42:45.427983 17164 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260812 02:42:45.430511 17199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:45.431748 17164 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:45.431877 17164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "47d5406a480e4276aa920bff97bf88c4"
format_stamp: "Formatted at 2026-08-12 02:42:45 on dist-test-slave-2p8l"
server_key: "3116f6e9ebc354b6e67d4c574f83b2b9"
server_key_iv: "71e028d95f9b638286953ac54f4d808c"
server_key_version: "encryptionkey@0"
I20260812 02:42:45.431988 17164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:45.463780 17164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:45.466833 17164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:45.467039 17164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:45.467651 17164 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:45.468477 17164 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:45.468554 17164 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:45.468638 17164 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:45.468684 17164 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:45.477540 17164 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:35227
I20260812 02:42:45.477610 17425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:35227 every 8 connection(s)
I20260812 02:42:45.478497 17164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:42:45.480680 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 17164
I20260812 02:42:45.480841 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:42:45.481144 10541 external_mini_cluster.cc:1428] Setting key 1b3cdcc3c1e97e9ccc57667d65a99893
Aug 12 02:42:45 dist-test-slave-2p8l krb5kdc[16964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502565, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.75.66@KRBTEST.COM; defaulting to no policy
I20260812 02:42:45.493286 17123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:45.480360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:42511 (local address 127.10.75.126:43575)
0812 02:42:45.480575 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:45.480580 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:45.481446 (+ 866us) server_negotiation.cc:407] Connection header received
0812 02:42:45.483138 (+ 1692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:45.483142 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:45.483193 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:45.483271 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:45.484466 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:45.485155 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:45.486515 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:45.486744 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:45.486828 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:45.489630 (+ 2802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:45.489633 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:45.489635 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:45.489658 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:45.491144 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:45.491659 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:45.491665 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:45.491667 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:45.491762 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:45.492215 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:45.492217 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:45.492219 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:45.492382 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:45.492459 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:45.493042 (+ 583us) server_negotiation.cc:299] Negotiation successful
0812 02:42:45.493147 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 02:42:45.494160 17429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:45.480759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:43575 (local address 127.10.75.65:42511)
0812 02:42:45.481297 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:45.481350 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:45.482925 (+ 1575us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:45.483436 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:45.483443 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:45.483850 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:45.484321 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:45.484334 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:45.485285 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:45.485295 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:45.486378 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:45.486393 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:45.486905 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:45.486911 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:45.487142 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:45.487763 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:45.487789 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:45.489457 (+ 1668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:45.491283 (+ 1826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:45.491288 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:45.491302 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:45.491552 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:45.491898 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:45.491902 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:45.491904 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:45.492099 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:45.492478 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:45.492483 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:45.492744 (+ 261us) client_negotiation.cc:769] Sending connection context
0812 02:42:45.492971 (+ 227us) client_negotiation.cc:240] Negotiation successful
0812 02:42:45.493225 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":159,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.66@KRBTEST.COM" created.
I20260812 02:42:45.495420 17426 heartbeater.cc:347] Connected to a master server at 127.10.75.126:43575
I20260812 02:42:45.495651 17426 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:45.496165 17426 heartbeater.cc:511] Master 127.10.75.126:43575 requested a full tablet report, sending...
I20260812 02:42:45.497841 17047 ts_manager.cc:194] Registered new tserver with Master: 47d5406a480e4276aa920bff97bf88c4 (127.10.75.65:35227)
I20260812 02:42:45.498999 17047 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:42511
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
I20260812 02:42:45.514287 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43575
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:45.628724 17433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:45.628975 17433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:45.629019 17433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:45.633070 17433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:45.633127 17433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:45.633183 17433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:42:45.638434 17433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43575
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:45.639391 17433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:45.640348 17433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 02:42:45.650324 17433 server_base.cc:1034] running on GCE node
W20260812 02:42:45.650233 17443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:45.650226 17450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:45.650233 17445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:45.650936 17433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:45.651574 17433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:45.652740 17433 hybrid_clock.cc:648] HybridClock initialized: now 1786502565652722 us; error 26 us; skew 500 ppm
Aug 12 02:42:45 dist-test-slave-2p8l krb5kdc[16964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502565, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:45.655692 17433 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:42:45.656584 17433 webserver.cc:460] Webserver started at http://127.10.75.66:37309/ using document root <none> and password file <none>
I20260812 02:42:45.657136 17433 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:45.657197 17433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:45.657409 17433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:45.659482 17433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "c8a9345865ad427eb003445a3ba369d6"
format_stamp: "Formatted at 2026-08-12 02:42:45 on dist-test-slave-2p8l"
server_key: "7bbf9696d0786c281c27e8bc78b1387f"
server_key_iv: "3ac4633c874956c91a7024b9ee3d6edc"
server_key_version: "encryptionkey@0"
I20260812 02:42:45.660044 17433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "c8a9345865ad427eb003445a3ba369d6"
format_stamp: "Formatted at 2026-08-12 02:42:45 on dist-test-slave-2p8l"
server_key: "7bbf9696d0786c281c27e8bc78b1387f"
server_key_iv: "3ac4633c874956c91a7024b9ee3d6edc"
server_key_version: "encryptionkey@0"
I20260812 02:42:45.663864 17433 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260812 02:42:45.666369 17460 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:45.667616 17433 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 02:42:45.667750 17433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "c8a9345865ad427eb003445a3ba369d6"
format_stamp: "Formatted at 2026-08-12 02:42:45 on dist-test-slave-2p8l"
server_key: "7bbf9696d0786c281c27e8bc78b1387f"
server_key_iv: "3ac4633c874956c91a7024b9ee3d6edc"
server_key_version: "encryptionkey@0"
I20260812 02:42:45.667858 17433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:45.688048 17433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:45.691077 17433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:45.691298 17433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:45.691890 17433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:45.692711 17433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:45.692760 17433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:45.692828 17433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:45.692865 17433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:45.702718 17433 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:46815
I20260812 02:42:45.702739 17674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:46815 every 8 connection(s)
I20260812 02:42:45.703580 17433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:42:45.711529 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 17433
I20260812 02:42:45.711679 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:42:45.711972 10541 external_mini_cluster.cc:1428] Setting key 5195bcbcfa524602360dc296529b1255
Aug 12 02:42:45 dist-test-slave-2p8l krb5kdc[16964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502565, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:45.717939 17123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:45.705382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:48713 (local address 127.10.75.126:43575)
0812 02:42:45.705521 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:45.705525 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:45.706416 (+ 891us) server_negotiation.cc:407] Connection header received
0812 02:42:45.707829 (+ 1413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:45.707833 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:45.707891 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:45.708002 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:45.709147 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:45.709683 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:45.710928 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:45.711166 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:45.711284 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:45.714008 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:45.714015 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:45.714021 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:45.714053 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:45.715763 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:45.716314 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:45.716319 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:45.716321 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:45.716408 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:45.716763 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:45.716767 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:45.716768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:45.716958 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:45.717071 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:45.717708 (+ 637us) server_negotiation.cc:299] Negotiation successful
0812 02:42:45.717821 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 02:42:45.719210 17679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:45.705770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:43575 (local address 127.10.75.66:48713)
0812 02:42:45.706266 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:45.706313 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:45.707619 (+ 1306us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:45.708174 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:45.708181 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:45.708525 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:45.708989 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:45.709002 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:45.709828 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:45.709832 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:45.710795 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:45.710805 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:45.711324 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:45.711328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:45.711495 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:45.712137 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:45.712154 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:45.713834 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:45.715918 (+ 2084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:45.715925 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:45.715940 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:45.716202 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:45.716513 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:45.716518 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:45.716520 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:45.716661 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:45.717070 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:45.717077 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:45.717407 (+ 330us) client_negotiation.cc:769] Sending connection context
0812 02:42:45.717634 (+ 227us) client_negotiation.cc:240] Negotiation successful
0812 02:42:45.717988 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":117,"threads_started":1}
I20260812 02:42:45.720439 17675 heartbeater.cc:347] Connected to a master server at 127.10.75.126:43575
I20260812 02:42:45.720733 17675 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:45.721360 17675 heartbeater.cc:511] Master 127.10.75.126:43575 requested a full tablet report, sending...
I20260812 02:42:45.722512 17047 ts_manager.cc:194] Registered new tserver with Master: c8a9345865ad427eb003445a3ba369d6 (127.10.75.66:46815)
I20260812 02:42:45.723073 17047 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:48713
WARNING: no policy specified for kudu/127.10.75.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
I20260812 02:42:45.744894 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43575
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:45.861084 17685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:45.861371 17685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:45.861456 17685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:45.865593 17685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:45.865681 17685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:45.865779 17685 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:42:45.871031 17685 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43575
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17685
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:45.872061 17685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:45.873059 17685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:45.882476 17694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:45.882472 17698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:45.882472 17702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:45.882875 17685 server_base.cc:1034] running on GCE node
I20260812 02:42:45.883247 17685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:45.883844 17685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:45.885062 17685 hybrid_clock.cc:648] HybridClock initialized: now 1786502565885044 us; error 26 us; skew 500 ppm
Aug 12 02:42:45 dist-test-slave-2p8l krb5kdc[16964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502565, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:45.888010 17685 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:42:45.888835 17685 webserver.cc:460] Webserver started at http://127.10.75.67:44651/ using document root <none> and password file <none>
I20260812 02:42:45.889374 17685 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:45.889433 17685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:45.889701 17685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:45.891772 17685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "a2fc55f54a004a25ad6496ed34da26b2"
format_stamp: "Formatted at 2026-08-12 02:42:45 on dist-test-slave-2p8l"
server_key: "c129015e440fa78d4dfc1863653a695d"
server_key_iv: "bb11ba64ddafb2c187b66db27db30507"
server_key_version: "encryptionkey@0"
I20260812 02:42:45.892319 17685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "a2fc55f54a004a25ad6496ed34da26b2"
format_stamp: "Formatted at 2026-08-12 02:42:45 on dist-test-slave-2p8l"
server_key: "c129015e440fa78d4dfc1863653a695d"
server_key_iv: "bb11ba64ddafb2c187b66db27db30507"
server_key_version: "encryptionkey@0"
I20260812 02:42:45.896302 17685 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 02:42:45.898849 17710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:45.900108 17685 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:42:45.900259 17685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "a2fc55f54a004a25ad6496ed34da26b2"
format_stamp: "Formatted at 2026-08-12 02:42:45 on dist-test-slave-2p8l"
server_key: "c129015e440fa78d4dfc1863653a695d"
server_key_iv: "bb11ba64ddafb2c187b66db27db30507"
server_key_version: "encryptionkey@0"
I20260812 02:42:45.900370 17685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:45.922693 17685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:45.925997 17685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:45.926255 17685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:45.926905 17685 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:45.927783 17685 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:45.927858 17685 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:45.927930 17685 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:45.927981 17685 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:45.939064 17685 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:38221
I20260812 02:42:45.939087 17940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:38221 every 8 connection(s)
I20260812 02:42:45.939991 17685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:42:45.942408 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 17685
I20260812 02:42:45.942507 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:42:45.942894 10541 external_mini_cluster.cc:1428] Setting key eb032b746e258da767d632494f104377
Aug 12 02:42:45 dist-test-slave-2p8l krb5kdc[16964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502565, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:45.954802 17123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:45.941906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:53743 (local address 127.10.75.126:43575)
0812 02:42:45.942123 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:45.942128 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:45.943169 (+ 1041us) server_negotiation.cc:407] Connection header received
0812 02:42:45.944978 (+ 1809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:45.944981 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:45.945080 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:45.945161 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:45.946460 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:45.947022 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:45.948225 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:45.948446 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:45.948538 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:45.951117 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:45.951120 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:45.951122 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:45.951146 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:45.952668 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:45.953150 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:45.953152 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:45.953154 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:45.953389 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:45.953755 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:45.953757 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:45.953759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:45.953941 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:45.954018 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:45.954581 (+ 563us) server_negotiation.cc:299] Negotiation successful
0812 02:42:45.954682 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 02:42:45.955614 17944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:45.942404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:43575 (local address 127.10.75.67:53743)
0812 02:42:45.942975 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:45.943057 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:45.944752 (+ 1695us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:45.945349 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:45.945356 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:45.945731 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:45.946304 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:45.946321 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:45.947147 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:45.947150 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:45.948092 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:45.948101 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:45.948590 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:45.948593 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:45.948744 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:45.949297 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:45.949314 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:45.950936 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:45.952777 (+ 1841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:45.952782 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:45.952793 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:45.953046 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:45.953498 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:45.953500 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:45.953501 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:45.953657 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:45.954031 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:45.954036 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:45.954325 (+ 289us) client_negotiation.cc:769] Sending connection context
0812 02:42:45.954480 (+ 155us) client_negotiation.cc:240] Negotiation successful
0812 02:42:45.954744 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":193,"threads_started":1}
I20260812 02:42:45.956755 17942 heartbeater.cc:347] Connected to a master server at 127.10.75.126:43575
I20260812 02:42:45.957002 17942 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:45.957546 17942 heartbeater.cc:511] Master 127.10.75.126:43575 requested a full tablet report, sending...
I20260812 02:42:45.958691 17047 ts_manager.cc:194] Registered new tserver with Master: a2fc55f54a004a25ad6496ed34da26b2 (127.10.75.67:38221)
I20260812 02:42:45.959250 17047 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:53743
I20260812 02:42:45.969345 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 02:42:45 dist-test-slave-2p8l krb5kdc[16964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 02:42:45 dist-test-slave-2p8l krb5kdc[16964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.65@KRBTEST.COM
I20260812 02:42:45.998169 17955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:45.987642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47470 (local address 127.10.75.65:35227)
0812 02:42:45.987951 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:45.987969 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:45.987994 (+ 25us) server_negotiation.cc:407] Connection header received
0812 02:42:45.988049 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:45.988054 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:45.988258 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:45.988387 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:45.989157 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:45.989978 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:45.990953 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:45.991348 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:45.991442 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:45.994218 (+ 2776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:45.994229 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:45.994244 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:45.994269 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:45.996066 (+ 1797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:45.996609 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:45.996615 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:45.996617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:45.996707 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:45.996953 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:45.996956 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:45.996957 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:45.997192 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:45.997361 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:45.997731 (+ 370us) server_negotiation.cc:299] Negotiation successful
0812 02:42:45.997927 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":82,"threads_started":1}
Aug 12 02:42:46 dist-test-slave-2p8l krb5kdc[16964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:46.009871 17123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:46.001116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51970 (local address 127.10.75.126:43575)
0812 02:42:46.001276 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:46.001282 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:46.001370 (+ 88us) server_negotiation.cc:407] Connection header received
0812 02:42:46.001541 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:46.001544 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:46.001599 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:46.001690 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:46.002413 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:46.002939 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:46.003718 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:46.004034 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:46.004138 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:46.006771 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:46.006775 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:46.006778 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:46.006809 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:46.008168 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:46.008584 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:46.008588 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:46.008590 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:46.008673 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:46.008953 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:46.008956 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:46.008958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:46.009185 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:46.009327 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:46.009578 (+ 251us) server_negotiation.cc:299] Negotiation successful
0812 02:42:46.009696 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260812 02:42:46.010406 17047 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51970
I20260812 02:42:46.011264 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 17164
I20260812 02:42:46.029799 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 17433
I20260812 02:42:46.051084 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 17685
I20260812 02:42:46.062172 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 16985
2026-08-12T02:42:46Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4046 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:42:46 dist-test-slave-2p8l krb5kdc[17967](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:42:46 dist-test-slave-2p8l krb5kdc[17967](info): set up 2 sockets
Aug 12 02:42:46 dist-test-slave-2p8l krb5kdc[17967](info): commencing operation
krb5kdc: starting...
W20260812 02:42:47.399835 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.308s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:42:47 dist-test-slave-2p8l krb5kdc[17967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:42:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:42:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:42:47.525830 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:35917
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:37339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:35917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:47.638216 17990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:47.638458 17990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:47.638527 17990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:47.642485 17990 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:42:47.642539 17990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:47.642560 17990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:47.642597 17990 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:42:47.642628 17990 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:42:47.648012 17990 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:37339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:35917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:35917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17990
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:47.649029 17990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:47.650131 17990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:47.658226 17999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:47.658269 18000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:47.658226 18007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:47.658435 17990 server_base.cc:1034] running on GCE node
I20260812 02:42:47.659063 17990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:47.660136 17990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:47.661327 17990 hybrid_clock.cc:648] HybridClock initialized: now 1786502567661321 us; error 32 us; skew 500 ppm
Aug 12 02:42:47 dist-test-slave-2p8l krb5kdc[17967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502567, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:47.667284 17990 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:42:47.667961 17990 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:47.668023 17990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:47.668183 17990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:47.670212 17990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "b893499dc66c4c3098994fc4e55c7bae"
format_stamp: "Formatted at 2026-08-12 02:42:47 on dist-test-slave-2p8l"
server_key: "e5b032e002d68c2d3f63475d691bdd51"
server_key_iv: "7c5f49274b5b521ce946074759d6ac78"
server_key_version: "encryptionkey@0"
I20260812 02:42:47.670733 17990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "b893499dc66c4c3098994fc4e55c7bae"
format_stamp: "Formatted at 2026-08-12 02:42:47 on dist-test-slave-2p8l"
server_key: "e5b032e002d68c2d3f63475d691bdd51"
server_key_iv: "7c5f49274b5b521ce946074759d6ac78"
server_key_version: "encryptionkey@0"
I20260812 02:42:47.674364 17990 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.002s
I20260812 02:42:47.676590 18025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:47.677758 17990 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:42:47.677886 17990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "b893499dc66c4c3098994fc4e55c7bae"
format_stamp: "Formatted at 2026-08-12 02:42:47 on dist-test-slave-2p8l"
server_key: "e5b032e002d68c2d3f63475d691bdd51"
server_key_iv: "7c5f49274b5b521ce946074759d6ac78"
server_key_version: "encryptionkey@0"
I20260812 02:42:47.677989 17990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:47.691550 17990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:47.694715 17990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:47.694914 17990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:47.701561 17990 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:35917
I20260812 02:42:47.701867 18121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:35917 every 8 connection(s)
I20260812 02:42:47.702299 17990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:42:47.704890 18123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:47.710186 18123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae: Bootstrap starting.
I20260812 02:42:47.711985 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 17990
I20260812 02:42:47.712152 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:42:47.712448 10541 external_mini_cluster.cc:1428] Setting key cf9a18ca28fca60715496d774331f77b
I20260812 02:42:47.712761 18123 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:47.713624 18123 log.cc:824] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:47.715790 18123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae: No bootstrap required, opened a new log
I20260812 02:42:47.719344 18123 raft_consensus.cc:348] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b893499dc66c4c3098994fc4e55c7bae" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35917 } }
I20260812 02:42:47.719643 18123 raft_consensus.cc:374] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:47.719724 18123 raft_consensus.cc:729] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b893499dc66c4c3098994fc4e55c7bae, State: Initialized, Role: FOLLOWER
I20260812 02:42:47.720192 18123 consensus_queue.cc:260] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b893499dc66c4c3098994fc4e55c7bae" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35917 } }
I20260812 02:42:47.720319 18123 raft_consensus.cc:388] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:42:47.720410 18123 raft_consensus.cc:482] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:42:47.720525 18123 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae [term 0 FOLLOWER]: Advancing to term 1
Aug 12 02:42:47 dist-test-slave-2p8l krb5kdc[17967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:47.721472 18123 raft_consensus.cc:504] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b893499dc66c4c3098994fc4e55c7bae" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35917 } }
I20260812 02:42:47.721841 18123 leader_election.cc:302] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b893499dc66c4c3098994fc4e55c7bae; no voters:
I20260812 02:42:47.722245 18123 leader_election.cc:288] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:42:47.722325 18129 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:47.722625 18129 raft_consensus.cc:686] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae [term 1 LEADER]: Becoming Leader. State: Replica: b893499dc66c4c3098994fc4e55c7bae, State: Running, Role: LEADER
I20260812 02:42:47.722982 18129 consensus_queue.cc:237] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b893499dc66c4c3098994fc4e55c7bae" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35917 } }
I20260812 02:42:47.723664 18123 sys_catalog.cc:564] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:42:47.724771 18132 sys_catalog.cc:455] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae [sys.catalog]: SysCatalogTable state changed. Reason: New leader b893499dc66c4c3098994fc4e55c7bae. Latest consensus state: current_term: 1 leader_uuid: "b893499dc66c4c3098994fc4e55c7bae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b893499dc66c4c3098994fc4e55c7bae" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35917 } } }
I20260812 02:42:47.724903 18132 sys_catalog.cc:458] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:47.725232 18138 sys_catalog.cc:455] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b893499dc66c4c3098994fc4e55c7bae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b893499dc66c4c3098994fc4e55c7bae" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35917 } } }
I20260812 02:42:47.725378 18138 sys_catalog.cc:458] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:47.727555 18127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:47.713648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53312 (local address 127.10.75.126:35917)
0812 02:42:47.714173 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:47.714192 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:47.714237 (+ 45us) server_negotiation.cc:407] Connection header received
0812 02:42:47.714990 (+ 753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:47.715010 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:47.715323 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:47.715690 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:47.716499 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:47.717481 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:47.718400 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:47.718860 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:47.719057 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:47.722036 (+ 2979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:47.722041 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:47.722053 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:47.722142 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:47.724038 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:47.724630 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:47.724636 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:47.724642 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:47.724787 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:47.725132 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:47.725135 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:47.725136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:47.725678 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:47.725942 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:47.726456 (+ 514us) server_negotiation.cc:299] Negotiation successful
0812 02:42:47.726778 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":135,"threads_started":1}
W20260812 02:42:47.728821 18159 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:42:47.728917 18159 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:42:47.729763 18147 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:42:47.730607 18147 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:42:47.736183 18147 catalog_manager.cc:1347] Generated new cluster ID: 36a2f0e4fdad42159df99686fd98d068
I20260812 02:42:47.736270 18147 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:42:47.744323 18147 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:42:47.745499 18147 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:42:47.758653 18147 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae: Generated new TSK 0
I20260812 02:42:47.759356 18147 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
I20260812 02:42:47.797389 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35917
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:37339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:47.936378 18172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:47.936635 18172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:47.936681 18172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:47.940992 18172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:47.941062 18172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:47.941174 18172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:42:47.947211 18172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:37339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:47.948133 18172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:47.949076 18172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:47.958295 18186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:47.958302 18183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:47.958299 18194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:47.958604 18172 server_base.cc:1034] running on GCE node
I20260812 02:42:47.958984 18172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:47.959582 18172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:47.960768 18172 hybrid_clock.cc:648] HybridClock initialized: now 1786502567960758 us; error 24 us; skew 500 ppm
Aug 12 02:42:47 dist-test-slave-2p8l krb5kdc[17967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502567, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:47.963428 18172 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:42:47.964119 18172 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:47.964213 18172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:47.964493 18172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:47.966521 18172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "2c3f71441745455fa154fe2ff2dd9b30"
format_stamp: "Formatted at 2026-08-12 02:42:47 on dist-test-slave-2p8l"
server_key: "bb1e5dd2cb5c272ab0179b2c730e06df"
server_key_iv: "5d1bb2822dd97ef2e21d5dfdc2a384dc"
server_key_version: "encryptionkey@0"
I20260812 02:42:47.967084 18172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "2c3f71441745455fa154fe2ff2dd9b30"
format_stamp: "Formatted at 2026-08-12 02:42:47 on dist-test-slave-2p8l"
server_key: "bb1e5dd2cb5c272ab0179b2c730e06df"
server_key_iv: "5d1bb2822dd97ef2e21d5dfdc2a384dc"
server_key_version: "encryptionkey@0"
I20260812 02:42:47.970554 18172 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 02:42:47.972728 18209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:47.973909 18172 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:42:47.974115 18172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "2c3f71441745455fa154fe2ff2dd9b30"
format_stamp: "Formatted at 2026-08-12 02:42:47 on dist-test-slave-2p8l"
server_key: "bb1e5dd2cb5c272ab0179b2c730e06df"
server_key_iv: "5d1bb2822dd97ef2e21d5dfdc2a384dc"
server_key_version: "encryptionkey@0"
I20260812 02:42:47.974246 18172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:48.001803 18172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:48.004822 18172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:48.005040 18172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:48.005653 18172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:48.006589 18172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:48.006662 18172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:48.006737 18172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:48.006781 18172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:48.016119 18172 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:46119
I20260812 02:42:48.016142 18426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:46119 every 8 connection(s)
I20260812 02:42:48.016687 18172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:42:48.025449 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 18172
I20260812 02:42:48.025594 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:42:48.025947 10541 external_mini_cluster.cc:1428] Setting key 913477f8e1760d009a3db10659242cf5
Aug 12 02:42:48 dist-test-slave-2p8l krb5kdc[17967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502567, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:48.033924 18127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.018417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:48925 (local address 127.10.75.126:35917)
0812 02:42:48.018571 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:48.018576 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:48.019765 (+ 1189us) server_negotiation.cc:407] Connection header received
0812 02:42:48.020613 (+ 848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:48.020616 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:48.020663 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:48.020736 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:48.021849 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.022439 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.023769 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.023995 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.024149 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.027093 (+ 2944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:48.027096 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:48.027099 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:48.027128 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:48.031499 (+ 4371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:48.032148 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:48.032152 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:48.032154 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:48.032246 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:48.032656 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:48.032659 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:48.032661 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:48.032857 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:48.032968 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:48.033617 (+ 649us) server_negotiation.cc:299] Negotiation successful
0812 02:42:48.033749 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 02:42:48.035163 18431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.018828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35917 (local address 127.10.75.65:48925)
0812 02:42:48.019618 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:48.019658 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:48.020389 (+ 731us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:48.020891 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:48.020897 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:48.021236 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:48.021722 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.021735 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.022604 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.022607 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.023624 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.023635 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.024202 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.024205 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.024367 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.024961 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:48.024977 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:48.026890 (+ 1913us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:48.031634 (+ 4744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:48.031642 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:48.031658 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:48.032044 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:48.032348 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:48.032353 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:48.032355 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:48.032537 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:48.032971 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:48.032980 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:48.033324 (+ 344us) client_negotiation.cc:769] Sending connection context
0812 02:42:48.033558 (+ 234us) client_negotiation.cc:240] Negotiation successful
0812 02:42:48.033887 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":117,"threads_started":1}
I20260812 02:42:48.036468 18428 heartbeater.cc:347] Connected to a master server at 127.10.75.126:35917
I20260812 02:42:48.036726 18428 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:48.037175 18428 heartbeater.cc:511] Master 127.10.75.126:35917 requested a full tablet report, sending...
I20260812 02:42:48.038992 18050 ts_manager.cc:194] Registered new tserver with Master: 2c3f71441745455fa154fe2ff2dd9b30 (127.10.75.65:46119)
WARNING: no policy specified for kudu/127.10.75.66@KRBTEST.COM; defaulting to no policy
I20260812 02:42:48.040570 18050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:48925
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
I20260812 02:42:48.061075 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35917
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:37339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:48.172981 18436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:48.173267 18436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:48.173348 18436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:48.177377 18436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:48.177453 18436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:48.177542 18436 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:42:48.182804 18436 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:37339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18436
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:48.183797 18436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:48.184795 18436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:48.194299 18448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:48.194478 18436 server_base.cc:1034] running on GCE node
W20260812 02:42:48.194352 18446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:48.194299 18444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:48.195039 18436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:48.195708 18436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:48.196888 18436 hybrid_clock.cc:648] HybridClock initialized: now 1786502568196870 us; error 26 us; skew 500 ppm
Aug 12 02:42:48 dist-test-slave-2p8l krb5kdc[17967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502568, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:48.199791 18436 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:42:48.200495 18436 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:48.200559 18436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:48.200721 18436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:48.202740 18436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "50d2d5d403de4cd18d73c4444a273612"
format_stamp: "Formatted at 2026-08-12 02:42:48 on dist-test-slave-2p8l"
server_key: "8cc09c5c57b30a5c0c224c781533a2b2"
server_key_iv: "b0f7f0cb4eaef95974439093af640f9b"
server_key_version: "encryptionkey@0"
I20260812 02:42:48.203260 18436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "50d2d5d403de4cd18d73c4444a273612"
format_stamp: "Formatted at 2026-08-12 02:42:48 on dist-test-slave-2p8l"
server_key: "8cc09c5c57b30a5c0c224c781533a2b2"
server_key_iv: "b0f7f0cb4eaef95974439093af640f9b"
server_key_version: "encryptionkey@0"
I20260812 02:42:48.206785 18436 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 02:42:48.209061 18457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:48.210325 18436 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:48.210464 18436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "50d2d5d403de4cd18d73c4444a273612"
format_stamp: "Formatted at 2026-08-12 02:42:48 on dist-test-slave-2p8l"
server_key: "8cc09c5c57b30a5c0c224c781533a2b2"
server_key_iv: "b0f7f0cb4eaef95974439093af640f9b"
server_key_version: "encryptionkey@0"
I20260812 02:42:48.210572 18436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:48.223897 18436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:48.227321 18436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:48.227510 18436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:48.228057 18436 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:48.228791 18436 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:48.228837 18436 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:48.228875 18436 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:48.228891 18436 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:48.237986 18436 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:38279
I20260812 02:42:48.238018 18671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:38279 every 8 connection(s)
I20260812 02:42:48.238708 18436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:42:48.248092 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 18436
Aug 12 02:42:48 dist-test-slave-2p8l krb5kdc[17967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502568, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:48.248188 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:42:48.248489 10541 external_mini_cluster.cc:1428] Setting key a6eab6767d992076260866523f198898
I20260812 02:42:48.252393 18127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.240588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:33981 (local address 127.10.75.126:35917)
0812 02:42:48.240758 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:48.240763 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:48.241970 (+ 1207us) server_negotiation.cc:407] Connection header received
0812 02:42:48.242905 (+ 935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:48.242908 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:48.242956 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:48.243032 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:48.244236 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.244790 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.245970 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.246260 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.246344 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.248794 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:48.248798 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:48.248801 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:48.248830 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:48.250410 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:48.250913 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:48.250917 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:48.250919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:48.251008 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:48.251347 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:48.251351 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:48.251353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:48.251524 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:48.251632 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:48.252092 (+ 460us) server_negotiation.cc:299] Negotiation successful
0812 02:42:48.252229 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 02:42:48.253242 18675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.240956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35917 (local address 127.10.75.66:33981)
0812 02:42:48.241821 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:48.241863 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:48.242715 (+ 852us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:48.243202 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:48.243209 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:48.243601 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:48.244076 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.244091 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.244909 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.244912 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.245855 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.245864 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.246397 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.246400 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.246582 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.247141 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:48.247157 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:48.248624 (+ 1467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:48.250536 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:48.250541 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:48.250562 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:48.250805 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:48.251103 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:48.251108 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:48.251110 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:48.251248 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:48.251631 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:48.251637 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:48.251867 (+ 230us) client_negotiation.cc:769] Sending connection context
0812 02:42:48.252049 (+ 182us) client_negotiation.cc:240] Negotiation successful
0812 02:42:48.252345 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":107,"threads_started":1}
I20260812 02:42:48.254395 18672 heartbeater.cc:347] Connected to a master server at 127.10.75.126:35917
I20260812 02:42:48.254635 18672 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:48.255239 18672 heartbeater.cc:511] Master 127.10.75.126:35917 requested a full tablet report, sending...
I20260812 02:42:48.256421 18050 ts_manager.cc:194] Registered new tserver with Master: 50d2d5d403de4cd18d73c4444a273612 (127.10.75.66:38279)
I20260812 02:42:48.257278 18050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:33981
WARNING: no policy specified for kudu/127.10.75.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
I20260812 02:42:48.281549 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35917
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:37339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:48.392715 18682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:48.392941 18682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:48.392982 18682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:48.396868 18682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:48.396916 18682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:48.396972 18682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:42:48.401990 18682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:37339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:48.402915 18682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:48.403839 18682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:48.413172 18689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:48.413241 18691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:48.413261 18688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:48.413720 18682 server_base.cc:1034] running on GCE node
I20260812 02:42:48.414225 18682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:48.414893 18682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:48.416054 18682 hybrid_clock.cc:648] HybridClock initialized: now 1786502568416032 us; error 32 us; skew 500 ppm
Aug 12 02:42:48 dist-test-slave-2p8l krb5kdc[17967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502568, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:48.418778 18682 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:42:48.419531 18682 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:48.419595 18682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:48.419754 18682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:48.421584 18682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "794a0dfb4e864d359295e6d72157828b"
format_stamp: "Formatted at 2026-08-12 02:42:48 on dist-test-slave-2p8l"
server_key: "1ecc10b8babfb09ec95050afffea656b"
server_key_iv: "2316f4afe9e9c4af3ad2316aafda2502"
server_key_version: "encryptionkey@0"
I20260812 02:42:48.422150 18682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "794a0dfb4e864d359295e6d72157828b"
format_stamp: "Formatted at 2026-08-12 02:42:48 on dist-test-slave-2p8l"
server_key: "1ecc10b8babfb09ec95050afffea656b"
server_key_iv: "2316f4afe9e9c4af3ad2316aafda2502"
server_key_version: "encryptionkey@0"
I20260812 02:42:48.425825 18682 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 02:42:48.428119 18700 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:48.429292 18682 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260812 02:42:48.429435 18682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "794a0dfb4e864d359295e6d72157828b"
format_stamp: "Formatted at 2026-08-12 02:42:48 on dist-test-slave-2p8l"
server_key: "1ecc10b8babfb09ec95050afffea656b"
server_key_iv: "2316f4afe9e9c4af3ad2316aafda2502"
server_key_version: "encryptionkey@0"
I20260812 02:42:48.429527 18682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:48.453018 18682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:48.456058 18682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:48.456247 18682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:48.456808 18682 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:48.457590 18682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:48.457636 18682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:48.457705 18682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:48.457742 18682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:48.466512 18682 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:40269
I20260812 02:42:48.466534 18940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:40269 every 8 connection(s)
I20260812 02:42:48.467087 18682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:42:48.468263 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 18682
I20260812 02:42:48.468400 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:42:48.468716 10541 external_mini_cluster.cc:1428] Setting key 34e63a9290959ab4e37a7a85d5c04f41
Aug 12 02:42:48 dist-test-slave-2p8l krb5kdc[17967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502568, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:48.486158 18127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.468981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:39813 (local address 127.10.75.126:35917)
0812 02:42:48.469336 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:48.469341 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:48.470325 (+ 984us) server_negotiation.cc:407] Connection header received
0812 02:42:48.471767 (+ 1442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:48.471771 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:48.471825 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:48.471909 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:48.473116 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.473648 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.474881 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.475112 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.475230 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.477632 (+ 2402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:48.477635 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:48.477637 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:48.477661 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:48.483988 (+ 6327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:48.484548 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:48.484553 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:48.484555 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:48.484641 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:48.485005 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:48.485010 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:48.485012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:48.485202 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:48.485314 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:48.485826 (+ 512us) server_negotiation.cc:299] Negotiation successful
0812 02:42:48.485957 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259}
I20260812 02:42:48.486937 18946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.469440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35917 (local address 127.10.75.67:39813)
0812 02:42:48.470155 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:48.470219 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:48.471575 (+ 1356us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:48.472090 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:48.472096 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:48.472537 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:48.472971 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.472984 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.473794 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.473802 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.474748 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.474758 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.475268 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.475272 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.475430 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.475945 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:48.475961 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:48.477393 (+ 1432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:48.484120 (+ 6727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:48.484127 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:48.484144 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:48.484422 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:48.484745 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:48.484749 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:48.484751 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:48.484904 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:48.485314 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:48.485322 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:48.485576 (+ 254us) client_negotiation.cc:769] Sending connection context
0812 02:42:48.485768 (+ 192us) client_negotiation.cc:240] Negotiation successful
0812 02:42:48.486134 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":158,"threads_started":1}
I20260812 02:42:48.488080 18942 heartbeater.cc:347] Connected to a master server at 127.10.75.126:35917
I20260812 02:42:48.488349 18942 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:48.488847 18942 heartbeater.cc:511] Master 127.10.75.126:35917 requested a full tablet report, sending...
I20260812 02:42:48.489902 18050 ts_manager.cc:194] Registered new tserver with Master: 794a0dfb4e864d359295e6d72157828b (127.10.75.67:40269)
I20260812 02:42:48.490630 18050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:39813
I20260812 02:42:48.494676 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:42:48.503979 18127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.496669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53322 (local address 127.10.75.126:35917)
0812 02:42:48.496799 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:48.496803 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:48.497031 (+ 228us) server_negotiation.cc:407] Connection header received
0812 02:42:48.497135 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:48.497138 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:48.497174 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:48.497242 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:48.497928 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.498483 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.499301 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.499502 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.499576 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.500872 (+ 1296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:48.500875 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:48.500877 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:48.500898 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:48.502427 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:48.502804 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:48.502806 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:48.502807 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:48.502880 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:48.503187 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:48.503189 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:48.503190 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:48.503392 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:48.503495 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:48.503763 (+ 268us) server_negotiation.cc:299] Negotiation successful
0812 02:42:48.503859 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 02:42:48.507181 18050 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53322:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:42:48.510221 18050 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:42:48.525465 18962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.519172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46894 (local address 127.10.75.65:46119)
0812 02:42:48.520080 (+ 908us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:48.520087 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:48.520110 (+ 23us) server_negotiation.cc:407] Connection header received
0812 02:42:48.520203 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:48.520209 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:48.520437 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:48.520615 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:48.521046 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.522248 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.523876 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.524745 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.524911 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.525078 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:48.525198 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 02:42:48.525299 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":786,"thread_start_us":142,"threads_started":1}
I20260812 02:42:48.525480 18964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.518998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:46119 (local address 127.0.0.1:46894)
0812 02:42:48.519594 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:48.519643 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:48.519787 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:48.520620 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:48.520626 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:48.520720 (+ 94us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:48.520891 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.520903 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.522400 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.522404 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.523743 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.523754 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.524886 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.524890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.524995 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.525020 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 02:42:48.525103 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 02:42:48.525259 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"mutex_wait_us":175,"spinlock_wait_cycles":11520,"thread_start_us":77,"threads_started":1}
I20260812 02:42:48.525859 18966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.519801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:40269 (local address 127.0.0.1:58516)
0812 02:42:48.521027 (+ 1226us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:48.521041 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:48.521137 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:48.521818 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:48.521822 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:48.521844 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:48.521949 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.521955 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.523225 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.523228 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.524340 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.524353 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.525470 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.525473 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.525571 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.525594 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 02:42:48.525649 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 02:42:48.525732 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1158,"mutex_wait_us":83,"thread_start_us":108,"threads_started":1}
I20260812 02:42:48.526001 18969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.519800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42868 (local address 127.10.75.66:38279)
0812 02:42:48.520259 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:48.520279 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:48.520308 (+ 29us) server_negotiation.cc:407] Connection header received
0812 02:42:48.520390 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:48.520395 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:48.520605 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:48.520761 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:48.521009 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.521795 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.523574 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.524462 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.524603 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.524758 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:48.525484 (+ 726us) server_negotiation.cc:299] Negotiation successful
0812 02:42:48.525764 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":111,"threads_started":1}
I20260812 02:42:48.526229 18961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.519197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:38279 (local address 127.0.0.1:42868)
0812 02:42:48.519650 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:48.519677 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:48.519787 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:48.520746 (+ 959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:48.520749 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:48.520771 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:48.520874 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.520879 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.521945 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.521948 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.523370 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.523382 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.524834 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.524839 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.524965 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.525007 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 02:42:48.525125 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 02:42:48.525257 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"mutex_wait_us":1,"spinlock_wait_cycles":7040,"thread_start_us":124,"threads_started":1}
I20260812 02:42:48.527208 18971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.520155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58516 (local address 127.10.75.67:40269)
0812 02:42:48.521377 (+ 1222us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:48.521388 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:48.521409 (+ 21us) server_negotiation.cc:407] Connection header received
0812 02:42:48.521480 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:48.521485 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:48.521660 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:48.521810 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:48.522106 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.523066 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.524512 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.525333 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.526773 (+ 1440us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.526929 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:48.526982 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 02:42:48.527063 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1119,"thread_start_us":158,"threads_started":1}
I20260812 02:42:48.528528 18295 tablet_service.cc:1467] Processing CreateTablet for tablet 7a94e05f3ae34459a6a9441b3fc511c9 (DEFAULT_TABLE table=test-table [id=28c923e036cb4422bac90113ce7229ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:48.528833 18548 tablet_service.cc:1467] Processing CreateTablet for tablet 7a94e05f3ae34459a6a9441b3fc511c9 (DEFAULT_TABLE table=test-table [id=28c923e036cb4422bac90113ce7229ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:48.529692 18295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a94e05f3ae34459a6a9441b3fc511c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:48.529850 18548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a94e05f3ae34459a6a9441b3fc511c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:48.530984 18814 tablet_service.cc:1467] Processing CreateTablet for tablet 7a94e05f3ae34459a6a9441b3fc511c9 (DEFAULT_TABLE table=test-table [id=28c923e036cb4422bac90113ce7229ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:48.532006 18814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a94e05f3ae34459a6a9441b3fc511c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:48.536372 18972 tablet_bootstrap.cc:492] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612: Bootstrap starting.
I20260812 02:42:48.538489 18972 tablet_bootstrap.cc:654] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:48.539362 18974 tablet_bootstrap.cc:492] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b: Bootstrap starting.
I20260812 02:42:48.539719 18972 log.cc:824] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:48.539999 18973 tablet_bootstrap.cc:492] T 7a94e05f3ae34459a6a9441b3fc511c9 P 2c3f71441745455fa154fe2ff2dd9b30: Bootstrap starting.
I20260812 02:42:48.541304 18974 tablet_bootstrap.cc:654] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:48.541862 18973 tablet_bootstrap.cc:654] T 7a94e05f3ae34459a6a9441b3fc511c9 P 2c3f71441745455fa154fe2ff2dd9b30: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:48.542439 18974 log.cc:824] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:48.542758 18973 log.cc:824] T 7a94e05f3ae34459a6a9441b3fc511c9 P 2c3f71441745455fa154fe2ff2dd9b30: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:48.543888 18972 tablet_bootstrap.cc:492] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612: No bootstrap required, opened a new log
I20260812 02:42:48.544088 18972 ts_tablet_manager.cc:1397] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260812 02:42:48.544363 18974 tablet_bootstrap.cc:492] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b: No bootstrap required, opened a new log
I20260812 02:42:48.544552 18974 ts_tablet_manager.cc:1397] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260812 02:42:48.545432 18973 tablet_bootstrap.cc:492] T 7a94e05f3ae34459a6a9441b3fc511c9 P 2c3f71441745455fa154fe2ff2dd9b30: No bootstrap required, opened a new log
I20260812 02:42:48.545636 18973 ts_tablet_manager.cc:1397] T 7a94e05f3ae34459a6a9441b3fc511c9 P 2c3f71441745455fa154fe2ff2dd9b30: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260812 02:42:48.548030 18972 raft_consensus.cc:348] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3f71441745455fa154fe2ff2dd9b30" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46119 } } peers { permanent_uuid: "50d2d5d403de4cd18d73c4444a273612" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 38279 } } peers { permanent_uuid: "794a0dfb4e864d359295e6d72157828b" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 40269 } }
I20260812 02:42:48.548166 18974 raft_consensus.cc:348] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3f71441745455fa154fe2ff2dd9b30" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46119 } } peers { permanent_uuid: "50d2d5d403de4cd18d73c4444a273612" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 38279 } } peers { permanent_uuid: "794a0dfb4e864d359295e6d72157828b" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 40269 } }
I20260812 02:42:48.548326 18972 raft_consensus.cc:374] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:48.548390 18974 raft_consensus.cc:374] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:48.548389 18972 raft_consensus.cc:729] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50d2d5d403de4cd18d73c4444a273612, State: Initialized, Role: FOLLOWER
I20260812 02:42:48.548441 18974 raft_consensus.cc:729] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 794a0dfb4e864d359295e6d72157828b, State: Initialized, Role: FOLLOWER
I20260812 02:42:48.548872 18974 consensus_queue.cc:260] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3f71441745455fa154fe2ff2dd9b30" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46119 } } peers { permanent_uuid: "50d2d5d403de4cd18d73c4444a273612" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 38279 } } peers { permanent_uuid: "794a0dfb4e864d359295e6d72157828b" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 40269 } }
I20260812 02:42:48.548872 18972 consensus_queue.cc:260] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3f71441745455fa154fe2ff2dd9b30" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46119 } } peers { permanent_uuid: "50d2d5d403de4cd18d73c4444a273612" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 38279 } } peers { permanent_uuid: "794a0dfb4e864d359295e6d72157828b" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 40269 } }
I20260812 02:42:48.549229 18973 raft_consensus.cc:348] T 7a94e05f3ae34459a6a9441b3fc511c9 P 2c3f71441745455fa154fe2ff2dd9b30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3f71441745455fa154fe2ff2dd9b30" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46119 } } peers { permanent_uuid: "50d2d5d403de4cd18d73c4444a273612" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 38279 } } peers { permanent_uuid: "794a0dfb4e864d359295e6d72157828b" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 40269 } }
I20260812 02:42:48.549469 18973 raft_consensus.cc:374] T 7a94e05f3ae34459a6a9441b3fc511c9 P 2c3f71441745455fa154fe2ff2dd9b30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:48.549538 18973 raft_consensus.cc:729] T 7a94e05f3ae34459a6a9441b3fc511c9 P 2c3f71441745455fa154fe2ff2dd9b30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3f71441745455fa154fe2ff2dd9b30, State: Initialized, Role: FOLLOWER
I20260812 02:42:48.549853 18974 ts_tablet_manager.cc:1428] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 02:42:48.549932 18972 ts_tablet_manager.cc:1428] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 02:42:48.549942 18942 heartbeater.cc:503] Master 127.10.75.126:35917 was elected leader, sending a full tablet report...
I20260812 02:42:48.549990 18973 consensus_queue.cc:260] T 7a94e05f3ae34459a6a9441b3fc511c9 P 2c3f71441745455fa154fe2ff2dd9b30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3f71441745455fa154fe2ff2dd9b30" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46119 } } peers { permanent_uuid: "50d2d5d403de4cd18d73c4444a273612" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 38279 } } peers { permanent_uuid: "794a0dfb4e864d359295e6d72157828b" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 40269 } }
I20260812 02:42:48.550228 18672 heartbeater.cc:503] Master 127.10.75.126:35917 was elected leader, sending a full tablet report...
I20260812 02:42:48.550971 18973 ts_tablet_manager.cc:1428] T 7a94e05f3ae34459a6a9441b3fc511c9 P 2c3f71441745455fa154fe2ff2dd9b30: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 02:42:48.551071 18428 heartbeater.cc:503] Master 127.10.75.126:35917 was elected leader, sending a full tablet report...
W20260812 02:42:48.719456 18943 tablet.cc:2369] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:42:48.730345 18980 raft_consensus.cc:482] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:42:48.730630 18980 raft_consensus.cc:504] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3f71441745455fa154fe2ff2dd9b30" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46119 } } peers { permanent_uuid: "50d2d5d403de4cd18d73c4444a273612" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 38279 } } peers { permanent_uuid: "794a0dfb4e864d359295e6d72157828b" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 40269 } }
I20260812 02:42:48.732347 18980 leader_election.cc:288] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3f71441745455fa154fe2ff2dd9b30 (127.10.75.65:46119), 50d2d5d403de4cd18d73c4444a273612 (127.10.75.66:38279)
I20260812 02:42:48.736577 18981 raft_consensus.cc:482] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:42:48.736752 18981 raft_consensus.cc:504] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3f71441745455fa154fe2ff2dd9b30" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46119 } } peers { permanent_uuid: "50d2d5d403de4cd18d73c4444a273612" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 38279 } } peers { permanent_uuid: "794a0dfb4e864d359295e6d72157828b" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 40269 } }
I20260812 02:42:48.737336 18946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.732665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:46119 (local address 127.10.75.67:37939)
0812 02:42:48.732884 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:48.732901 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:48.733005 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:48.733330 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:48.733335 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:48.733362 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:48.733526 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.733532 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.734681 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.734687 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.736063 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.736070 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.736878 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.736882 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.736989 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.737010 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 02:42:48.737113 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 02:42:48.737195 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":60,"spinlock_wait_cycles":5504}
I20260812 02:42:48.737334 18962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.732759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:37939 (local address 127.10.75.65:46119)
0812 02:42:48.732921 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:48.732926 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:48.732949 (+ 23us) server_negotiation.cc:407] Connection header received
0812 02:42:48.733127 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:48.733132 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:48.733205 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:48.733298 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:48.733664 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.734548 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.736207 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.736759 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.736878 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.736935 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:48.737131 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 02:42:48.737206 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 02:42:48.737536 18969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.732932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:52325 (local address 127.10.75.66:38279)
0812 02:42:48.733087 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:48.733093 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:48.733452 (+ 359us) server_negotiation.cc:407] Connection header received
0812 02:42:48.733517 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:48.733520 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:48.733632 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:48.733739 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:48.734037 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.734666 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.736187 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.736810 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.736931 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.736979 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:48.737337 (+ 358us) server_negotiation.cc:299] Negotiation successful
0812 02:42:48.737415 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 02:42:48.737880 18984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.732699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:38279 (local address 127.10.75.67:52325)
0812 02:42:48.733312 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:48.733325 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:48.733441 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:48.733749 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:48.733752 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:48.733772 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:48.733872 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.733878 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.734767 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.734770 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.736051 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.736063 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.737058 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.737062 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.737176 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.737198 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 02:42:48.737663 (+ 465us) client_negotiation.cc:240] Negotiation successful
0812 02:42:48.737738 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"mutex_wait_us":27,"spinlock_wait_cycles":3584,"thread_start_us":128,"threads_started":1}
I20260812 02:42:48.738045 18981 leader_election.cc:288] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3f71441745455fa154fe2ff2dd9b30 (127.10.75.65:46119), 794a0dfb4e864d359295e6d72157828b (127.10.75.67:40269)
I20260812 02:42:48.738023 18330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a94e05f3ae34459a6a9441b3fc511c9" candidate_uuid: "794a0dfb4e864d359295e6d72157828b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3f71441745455fa154fe2ff2dd9b30" is_pre_election: true
I20260812 02:42:48.738365 18330 raft_consensus.cc:2454] T 7a94e05f3ae34459a6a9441b3fc511c9 P 2c3f71441745455fa154fe2ff2dd9b30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 794a0dfb4e864d359295e6d72157828b in term 0.
I20260812 02:42:48.739436 18585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a94e05f3ae34459a6a9441b3fc511c9" candidate_uuid: "794a0dfb4e864d359295e6d72157828b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50d2d5d403de4cd18d73c4444a273612" is_pre_election: true
I20260812 02:42:48.739500 18704 leader_election.cc:302] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3f71441745455fa154fe2ff2dd9b30, 794a0dfb4e864d359295e6d72157828b; no voters:
I20260812 02:42:48.739616 18585 raft_consensus.cc:2454] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 794a0dfb4e864d359295e6d72157828b in term 0.
I20260812 02:42:48.739809 18980 raft_consensus.cc:2781] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:42:48.739956 18980 raft_consensus.cc:482] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 02:42:48.739974 18674 tablet.cc:2369] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:42:48.740080 18980 raft_consensus.cc:3037] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:48.741542 18980 raft_consensus.cc:504] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3f71441745455fa154fe2ff2dd9b30" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46119 } } peers { permanent_uuid: "50d2d5d403de4cd18d73c4444a273612" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 38279 } } peers { permanent_uuid: "794a0dfb4e864d359295e6d72157828b" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 40269 } }
I20260812 02:42:48.742287 18330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a94e05f3ae34459a6a9441b3fc511c9" candidate_uuid: "794a0dfb4e864d359295e6d72157828b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3f71441745455fa154fe2ff2dd9b30"
I20260812 02:42:48.742272 18585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a94e05f3ae34459a6a9441b3fc511c9" candidate_uuid: "794a0dfb4e864d359295e6d72157828b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50d2d5d403de4cd18d73c4444a273612"
I20260812 02:42:48.742413 18330 raft_consensus.cc:3037] T 7a94e05f3ae34459a6a9441b3fc511c9 P 2c3f71441745455fa154fe2ff2dd9b30 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:48.742431 18585 raft_consensus.cc:3037] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:48.742523 18971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.738533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:46989 (local address 127.10.75.67:40269)
0812 02:42:48.738661 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:48.738667 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:48.738678 (+ 11us) server_negotiation.cc:407] Connection header received
0812 02:42:48.738713 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:48.738716 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:48.738761 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:48.738826 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:48.739121 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.739817 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.741266 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.741694 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.741804 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.741850 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:48.742350 (+ 500us) server_negotiation.cc:299] Negotiation successful
0812 02:42:48.742421 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 02:42:48.743626 18585 raft_consensus.cc:2454] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 794a0dfb4e864d359295e6d72157828b in term 1.
I20260812 02:42:48.743819 18330 raft_consensus.cc:2454] T 7a94e05f3ae34459a6a9441b3fc511c9 P 2c3f71441745455fa154fe2ff2dd9b30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 794a0dfb4e864d359295e6d72157828b in term 1.
I20260812 02:42:48.744014 18706 leader_election.cc:302] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50d2d5d403de4cd18d73c4444a273612, 794a0dfb4e864d359295e6d72157828b; no voters:
I20260812 02:42:48.744331 18988 raft_consensus.cc:2781] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:48.744355 18675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.738350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:40269 (local address 127.10.75.66:46989)
0812 02:42:48.738479 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:48.738496 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:48.738574 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:48.738860 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:48.738863 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:48.738883 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:48.739001 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.739010 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.739927 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.739932 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.741152 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.741163 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.741929 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.741933 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.742053 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.742093 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 02:42:48.742170 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 02:42:48.742256 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 02:42:48.744591 18988 raft_consensus.cc:686] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [term 1 LEADER]: Becoming Leader. State: Replica: 794a0dfb4e864d359295e6d72157828b, State: Running, Role: LEADER
I20260812 02:42:48.744753 18980 leader_election.cc:288] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [CANDIDATE]: Term 1 election: Requested vote from peers 2c3f71441745455fa154fe2ff2dd9b30 (127.10.75.65:46119), 50d2d5d403de4cd18d73c4444a273612 (127.10.75.66:38279)
I20260812 02:42:48.744932 18860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a94e05f3ae34459a6a9441b3fc511c9" candidate_uuid: "50d2d5d403de4cd18d73c4444a273612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "794a0dfb4e864d359295e6d72157828b" is_pre_election: true
I20260812 02:42:48.744946 18988 consensus_queue.cc:237] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3f71441745455fa154fe2ff2dd9b30" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46119 } } peers { permanent_uuid: "50d2d5d403de4cd18d73c4444a273612" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 38279 } } peers { permanent_uuid: "794a0dfb4e864d359295e6d72157828b" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 40269 } }
I20260812 02:42:48.745808 18962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.738896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:43705 (local address 127.10.75.65:46119)
0812 02:42:48.740954 (+ 2058us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:48.740960 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:48.740976 (+ 16us) server_negotiation.cc:407] Connection header received
0812 02:42:48.741013 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:48.741016 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:48.741067 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:48.741144 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:48.741541 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.742244 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.743732 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.744359 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.744456 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.744533 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:48.745629 (+ 1096us) server_negotiation.cc:299] Negotiation successful
0812 02:42:48.745697 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1983}
I20260812 02:42:48.746213 18987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.738824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:46119 (local address 127.10.75.66:43705)
0812 02:42:48.739089 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:48.739104 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:48.739186 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:48.741245 (+ 2059us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:48.741248 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:48.741266 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:48.741396 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.741406 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.742388 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.742390 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.743571 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:48.743585 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.744653 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.744656 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:48.745474 (+ 818us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.745507 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 02:42:48.745949 (+ 442us) client_negotiation.cc:240] Negotiation successful
0812 02:42:48.746020 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":78,"threads_started":1}
I20260812 02:42:48.746661 18330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a94e05f3ae34459a6a9441b3fc511c9" candidate_uuid: "50d2d5d403de4cd18d73c4444a273612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3f71441745455fa154fe2ff2dd9b30" is_pre_election: true
I20260812 02:42:48.746860 18330 raft_consensus.cc:2379] T 7a94e05f3ae34459a6a9441b3fc511c9 P 2c3f71441745455fa154fe2ff2dd9b30 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50d2d5d403de4cd18d73c4444a273612 in current term 1: Already voted for candidate 794a0dfb4e864d359295e6d72157828b in this term.
I20260812 02:42:48.747828 18463 leader_election.cc:302] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50d2d5d403de4cd18d73c4444a273612; no voters: 2c3f71441745455fa154fe2ff2dd9b30, 794a0dfb4e864d359295e6d72157828b
I20260812 02:42:48.748109 18981 raft_consensus.cc:2726] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 02:42:48.748805 18049 catalog_manager.cc:5495] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b reported cstate change: term changed from 0 to 1, leader changed from <none> to 794a0dfb4e864d359295e6d72157828b (127.10.75.67). New cstate: current_term: 1 leader_uuid: "794a0dfb4e864d359295e6d72157828b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3f71441745455fa154fe2ff2dd9b30" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50d2d5d403de4cd18d73c4444a273612" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "794a0dfb4e864d359295e6d72157828b" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 40269 } health_report { overall_health: HEALTHY } } }
I20260812 02:42:48.765479 18971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.760670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58532 (local address 127.10.75.67:40269)
0812 02:42:48.760801 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:48.760806 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:48.760820 (+ 14us) server_negotiation.cc:407] Connection header received
0812 02:42:48.760894 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:48.760897 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:48.760962 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:48.761073 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:42:48.761374 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.762132 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.763401 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:48.763716 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:48.763811 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:48.764241 (+ 430us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:42:48.764775 (+ 534us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:42:48.764887 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:48.765279 (+ 392us) server_negotiation.cc:299] Negotiation successful
0812 02:42:48.765334 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260812 02:42:48.768069 18429 tablet.cc:2369] T 7a94e05f3ae34459a6a9441b3fc511c9 P 2c3f71441745455fa154fe2ff2dd9b30: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:42:48.771636 18585 raft_consensus.cc:1261] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612 [term 1 FOLLOWER]: Refusing update from remote peer 794a0dfb4e864d359295e6d72157828b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:42:48.771684 18330 raft_consensus.cc:1261] T 7a94e05f3ae34459a6a9441b3fc511c9 P 2c3f71441745455fa154fe2ff2dd9b30 [term 1 FOLLOWER]: Refusing update from remote peer 794a0dfb4e864d359295e6d72157828b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:42:48.772332 18988 consensus_queue.cc:1035] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [LEADER]: Connected to new peer: Peer: permanent_uuid: "50d2d5d403de4cd18d73c4444a273612" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:48.772863 18990 consensus_queue.cc:1035] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3f71441745455fa154fe2ff2dd9b30" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:48.780995 18997 mvcc.cc:205] Tried to move back new op lower bound from 7317514521680347136 to 7317514521582313472. Current Snapshot: MvccSnapshot[applied={T|T < 7317514521680347136}]
I20260812 02:42:48.792532 18048 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:42:48.792730 18048 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:42:48.795168 18048 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b893499dc66c4c3098994fc4e55c7bae: Sending DeleteTablet for 3 replicas of tablet 7a94e05f3ae34459a6a9441b3fc511c9
I20260812 02:42:48.795994 18548 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a94e05f3ae34459a6a9441b3fc511c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:48 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:42868
I20260812 02:42:48.796109 18295 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a94e05f3ae34459a6a9441b3fc511c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:48 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:46894
I20260812 02:42:48.796659 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 18172
I20260812 02:42:48.796768 19015 tablet_replica.cc:330] T 7a94e05f3ae34459a6a9441b3fc511c9 P 2c3f71441745455fa154fe2ff2dd9b30: stopping tablet replica
I20260812 02:42:48.796787 18814 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a94e05f3ae34459a6a9441b3fc511c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:48 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:58516
I20260812 02:42:48.797112 19015 raft_consensus.cc:2229] T 7a94e05f3ae34459a6a9441b3fc511c9 P 2c3f71441745455fa154fe2ff2dd9b30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:42:48.800273 19014 tablet_replica.cc:330] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612: stopping tablet replica
I20260812 02:42:48.800714 19014 raft_consensus.cc:2229] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:42:48.801129 19014 raft_consensus.cc:2258] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:48.807250 19014 ts_tablet_manager.cc:1905] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:48.810808 19014 ts_tablet_manager.cc:1918] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:42:48.811158 19018 tablet_replica.cc:330] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b: stopping tablet replica
I20260812 02:42:48.811589 19018 raft_consensus.cc:2229] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:42:48.811769 19014 log.cc:1196] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/7a94e05f3ae34459a6a9441b3fc511c9
I20260812 02:42:48.812260 19018 raft_consensus.cc:2258] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:48.812714 19014 ts_tablet_manager.cc:1939] T 7a94e05f3ae34459a6a9441b3fc511c9 P 50d2d5d403de4cd18d73c4444a273612: Deleting consensus metadata
I20260812 02:42:48.816665 19018 ts_tablet_manager.cc:1905] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:48.819521 19018 ts_tablet_manager.cc:1918] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:42:48.819708 19018 log.cc:1196] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/7a94e05f3ae34459a6a9441b3fc511c9
I20260812 02:42:48.820106 19018 ts_tablet_manager.cc:1939] T 7a94e05f3ae34459a6a9441b3fc511c9 P 794a0dfb4e864d359295e6d72157828b: Deleting consensus metadata
I20260812 02:42:48.821480 18030 catalog_manager.cc:4841] TS 794a0dfb4e864d359295e6d72157828b (127.10.75.67:40269): tablet 7a94e05f3ae34459a6a9441b3fc511c9 (table test-table [id=28c923e036cb4422bac90113ce7229ff]) successfully deleted
I20260812 02:42:48.833760 18028 catalog_manager.cc:4841] TS 50d2d5d403de4cd18d73c4444a273612 (127.10.75.66:38279): tablet 7a94e05f3ae34459a6a9441b3fc511c9 (table test-table [id=28c923e036cb4422bac90113ce7229ff]) successfully deleted
W20260812 02:42:48.843397 18027 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.75.65:46119 (error 108)
I20260812 02:42:48.844308 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 18436
I20260812 02:42:48.844815 18961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:48.844368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:46119 (local address 127.0.0.1:46910)
0812 02:42:48.844604 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:48.844686 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.65:46119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
W20260812 02:42:48.850160 18027 catalog_manager.cc:4584] TS 2c3f71441745455fa154fe2ff2dd9b30 (127.10.75.65:46119): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7a94e05f3ae34459a6a9441b3fc511c9: Network error: Client connection negotiation failed: client connection to 127.10.75.65:46119: connect: Connection refused (error 111)
I20260812 02:42:48.859309 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 18682
I20260812 02:42:48.871258 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 17990
2026-08-12T02:42:48Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2808 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T02:42:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:42:48Z Disabled control of system clock
I20260812 02:42:48.909255 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:45733
--webserver_interface=127.10.75.126
--webserver_port=0
--builtin_ntp_servers=127.10.75.84:46835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:45733
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 02:42:49.024178 19027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:49.024422 19027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:49.024523 19027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:49.028524 19027 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:42:49.028575 19027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:49.028591 19027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:49.028607 19027 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:42:49.028623 19027 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:42:49.033174 19027 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:46835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:45733
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:45733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:49.034155 19027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:49.035475 19027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:49.043829 19034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:49.043853 19035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:49.044023 19027 server_base.cc:1034] running on GCE node
W20260812 02:42:49.044293 19040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:49.044903 19027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:49.045904 19027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:49.047086 19027 hybrid_clock.cc:648] HybridClock initialized: now 1786502569047062 us; error 46 us; skew 500 ppm
I20260812 02:42:49.048910 19027 webserver.cc:460] Webserver started at http://127.10.75.126:34225/ using document root <none> and password file <none>
I20260812 02:42:49.049466 19027 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:49.049575 19027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:49.049803 19027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:49.051805 19027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "059fab1f54c94997805d671ca25dce94"
format_stamp: "Formatted at 2026-08-12 02:42:49 on dist-test-slave-2p8l"
server_key: "226582a7975241bbb347be5f103b43a9"
server_key_iv: "72c164bedeeb23b4d9d6b4e046c75999"
server_key_version: "encryptionkey@0"
I20260812 02:42:49.052489 19027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "059fab1f54c94997805d671ca25dce94"
format_stamp: "Formatted at 2026-08-12 02:42:49 on dist-test-slave-2p8l"
server_key: "226582a7975241bbb347be5f103b43a9"
server_key_iv: "72c164bedeeb23b4d9d6b4e046c75999"
server_key_version: "encryptionkey@0"
I20260812 02:42:49.057353 19027 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 02:42:49.059660 19048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:49.060855 19027 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:42:49.060958 19027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "059fab1f54c94997805d671ca25dce94"
format_stamp: "Formatted at 2026-08-12 02:42:49 on dist-test-slave-2p8l"
server_key: "226582a7975241bbb347be5f103b43a9"
server_key_iv: "72c164bedeeb23b4d9d6b4e046c75999"
server_key_version: "encryptionkey@0"
I20260812 02:42:49.061040 19027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:49.065312 19027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:49.065841 19027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:49.065976 19027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:49.072453 19027 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:45733
I20260812 02:42:49.072467 19135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:45733 every 8 connection(s)
I20260812 02:42:49.073308 19027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:42:49.075006 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 19027
I20260812 02:42:49.075145 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:42:49.075444 10541 external_mini_cluster.cc:1428] Setting key 084fa88dbd786b91996d94753a116983
I20260812 02:42:49.077044 19136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:49.081030 19139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:49.076965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36362 (local address 127.10.75.126:45733)
0812 02:42:49.077602 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:49.077616 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:49.077649 (+ 33us) server_negotiation.cc:407] Connection header received
0812 02:42:49.078372 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:49.078389 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:49.078709 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:49.079028 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:49.079832 (+ 804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:49.079837 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:49.079848 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:42:49.079858 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:49.079913 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:42:49.079928 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:49.080078 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:49.080148 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 02:42:49.080414 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":142,"threads_started":1}
I20260812 02:42:49.082683 19136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94: Bootstrap starting.
I20260812 02:42:49.084892 19136 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:49.085628 19136 log.cc:824] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:49.087467 19136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94: No bootstrap required, opened a new log
I20260812 02:42:49.090838 19136 raft_consensus.cc:348] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "059fab1f54c94997805d671ca25dce94" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 45733 } }
I20260812 02:42:49.091065 19136 raft_consensus.cc:374] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:49.091146 19136 raft_consensus.cc:729] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 059fab1f54c94997805d671ca25dce94, State: Initialized, Role: FOLLOWER
I20260812 02:42:49.091596 19136 consensus_queue.cc:260] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "059fab1f54c94997805d671ca25dce94" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 45733 } }
I20260812 02:42:49.091754 19136 raft_consensus.cc:388] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:42:49.091843 19136 raft_consensus.cc:482] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:42:49.091943 19136 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:49.092782 19136 raft_consensus.cc:504] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "059fab1f54c94997805d671ca25dce94" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 45733 } }
I20260812 02:42:49.093116 19136 leader_election.cc:302] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 059fab1f54c94997805d671ca25dce94; no voters:
I20260812 02:42:49.093408 19136 leader_election.cc:288] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:42:49.093535 19141 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:49.093786 19141 raft_consensus.cc:686] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94 [term 1 LEADER]: Becoming Leader. State: Replica: 059fab1f54c94997805d671ca25dce94, State: Running, Role: LEADER
I20260812 02:42:49.094095 19141 consensus_queue.cc:237] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "059fab1f54c94997805d671ca25dce94" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 45733 } }
I20260812 02:42:49.094650 19136 sys_catalog.cc:564] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:42:49.095700 19147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 059fab1f54c94997805d671ca25dce94. Latest consensus state: current_term: 1 leader_uuid: "059fab1f54c94997805d671ca25dce94" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "059fab1f54c94997805d671ca25dce94" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 45733 } } }
I20260812 02:42:49.095718 19145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "059fab1f54c94997805d671ca25dce94" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "059fab1f54c94997805d671ca25dce94" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 45733 } } }
I20260812 02:42:49.095849 19145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:49.095849 19147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:49.096266 19163 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:42:49.099459 19163 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:42:49.105098 19163 catalog_manager.cc:1347] Generated new cluster ID: a098923ea53746138ec5c04f34131528
I20260812 02:42:49.105166 19163 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:42:49.113485 19163 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:42:49.113777 19163 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:42:49.118513 19163 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94: Generated new TSK 0
I20260812 02:42:49.119107 19163 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:42:49.131853 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:45733
--builtin_ntp_servers=127.10.75.84:46835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 02:42:49.264609 19177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:49.264860 19177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:49.264899 19177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:49.268961 19177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:49.269009 19177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:49.269062 19177 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:42:49.273638 19177 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:46835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:45733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19177
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:49.274607 19177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:49.275913 19177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:49.285636 19189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:49.285637 19188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:49.285790 19177 server_base.cc:1034] running on GCE node
W20260812 02:42:49.285936 19196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:49.286351 19177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:49.286974 19177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:49.288144 19177 hybrid_clock.cc:648] HybridClock initialized: now 1786502569288134 us; error 29 us; skew 500 ppm
I20260812 02:42:49.289986 19177 webserver.cc:460] Webserver started at http://127.10.75.65:41581/ using document root <none> and password file <none>
I20260812 02:42:49.290588 19177 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:49.290652 19177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:49.290859 19177 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:49.292841 19177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "ebbeece0148f4c2cb34c9032dcd98089"
format_stamp: "Formatted at 2026-08-12 02:42:49 on dist-test-slave-2p8l"
server_key: "c93453914f914091c0440ba684db5202"
server_key_iv: "acce69d4b6553eb685d5b3c56fd6545c"
server_key_version: "encryptionkey@0"
I20260812 02:42:49.293394 19177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "ebbeece0148f4c2cb34c9032dcd98089"
format_stamp: "Formatted at 2026-08-12 02:42:49 on dist-test-slave-2p8l"
server_key: "c93453914f914091c0440ba684db5202"
server_key_iv: "acce69d4b6553eb685d5b3c56fd6545c"
server_key_version: "encryptionkey@0"
I20260812 02:42:49.297302 19177 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 02:42:49.299765 19206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:49.300945 19177 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:42:49.301043 19177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "ebbeece0148f4c2cb34c9032dcd98089"
format_stamp: "Formatted at 2026-08-12 02:42:49 on dist-test-slave-2p8l"
server_key: "c93453914f914091c0440ba684db5202"
server_key_iv: "acce69d4b6553eb685d5b3c56fd6545c"
server_key_version: "encryptionkey@0"
I20260812 02:42:49.301126 19177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:49.305428 19177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:49.305961 19177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:49.306159 19177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:49.306644 19177 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:49.307494 19177 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:49.307547 19177 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:49.307585 19177 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:49.307606 19177 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:49.316190 19177 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:45033
I20260812 02:42:49.316220 19425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:45033 every 8 connection(s)
I20260812 02:42:49.317090 19177 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:42:49.319646 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 19177
I20260812 02:42:49.319780 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:42:49.320084 10541 external_mini_cluster.cc:1428] Setting key e31e79bb65bb6abbea6e218caef17828
I20260812 02:42:49.322247 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:45733
--builtin_ntp_servers=127.10.75.84:46835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 02:42:49.323988 19139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:49.318919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:45433 (local address 127.10.75.126:45733)
0812 02:42:49.319067 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:49.319072 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:49.320172 (+ 1100us) server_negotiation.cc:407] Connection header received
0812 02:42:49.321988 (+ 1816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:49.321991 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:49.322032 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:49.322287 (+ 255us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:49.323494 (+ 1207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:49.323498 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:49.323500 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:42:49.323512 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:49.323534 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:42:49.323550 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:49.323645 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:49.323808 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 02:42:49.323854 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 02:42:49.324817 19429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:49.319339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:45733 (local address 127.10.75.65:45433)
0812 02:42:49.320021 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:49.320069 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:49.321738 (+ 1669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:49.322470 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:49.322478 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:49.322576 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:49.323210 (+ 634us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:42:49.323212 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:49.323253 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:42:49.323321 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:49.323634 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:49.323644 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:49.323651 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 02:42:49.323851 (+ 200us) client_negotiation.cc:240] Negotiation successful
0812 02:42:49.324084 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":143,"threads_started":1}
I20260812 02:42:49.326165 19427 heartbeater.cc:347] Connected to a master server at 127.10.75.126:45733
I20260812 02:42:49.326404 19427 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:49.326808 19427 heartbeater.cc:511] Master 127.10.75.126:45733 requested a full tablet report, sending...
I20260812 02:42:49.328572 19079 ts_manager.cc:194] Registered new tserver with Master: ebbeece0148f4c2cb34c9032dcd98089 (127.10.75.65:45033)
W20260812 02:42:49.434762 19430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:49.434989 19430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:49.435026 19430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:49.438939 19430 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:49.438989 19430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:49.439041 19430 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:42:49.443845 19430 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:46835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:45733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19430
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:49.444813 19430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:49.446144 19430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 02:42:49.455561 19430 server_base.cc:1034] running on GCE node
W20260812 02:42:49.455608 19445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:49.455638 19447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:49.455539 19441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:49.456173 19430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:49.456790 19430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:49.457954 19430 hybrid_clock.cc:648] HybridClock initialized: now 1786502569457918 us; error 48 us; skew 500 ppm
I20260812 02:42:49.459722 19430 webserver.cc:460] Webserver started at http://127.10.75.66:46577/ using document root <none> and password file <none>
I20260812 02:42:49.460265 19430 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:49.460325 19430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:49.460574 19430 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:49.462569 19430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "dbb02521b08c4c83bed1f94caa6b64e1"
format_stamp: "Formatted at 2026-08-12 02:42:49 on dist-test-slave-2p8l"
server_key: "f2b5002abea79f67e2bab8d0c4cd57e7"
server_key_iv: "2bff1b7e2d0f834bccab51251b7816b3"
server_key_version: "encryptionkey@0"
I20260812 02:42:49.463126 19430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "dbb02521b08c4c83bed1f94caa6b64e1"
format_stamp: "Formatted at 2026-08-12 02:42:49 on dist-test-slave-2p8l"
server_key: "f2b5002abea79f67e2bab8d0c4cd57e7"
server_key_iv: "2bff1b7e2d0f834bccab51251b7816b3"
server_key_version: "encryptionkey@0"
I20260812 02:42:49.466768 19430 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 02:42:49.469133 19458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:49.470360 19430 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:49.470487 19430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "dbb02521b08c4c83bed1f94caa6b64e1"
format_stamp: "Formatted at 2026-08-12 02:42:49 on dist-test-slave-2p8l"
server_key: "f2b5002abea79f67e2bab8d0c4cd57e7"
server_key_iv: "2bff1b7e2d0f834bccab51251b7816b3"
server_key_version: "encryptionkey@0"
I20260812 02:42:49.470597 19430 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:49.474987 19430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:49.475562 19430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:49.475747 19430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:49.476274 19430 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:49.477128 19430 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:49.477197 19430 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:49.477260 19430 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:49.477303 19430 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:49.486531 19430 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:36289
I20260812 02:42:49.486557 19665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:36289 every 8 connection(s)
I20260812 02:42:49.487373 19430 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:42:49.489748 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 19430
I20260812 02:42:49.489877 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:42:49.490255 10541 external_mini_cluster.cc:1428] Setting key d89f2a00948db54dc89092faeee77dcd
I20260812 02:42:49.492491 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:45733
--builtin_ntp_servers=127.10.75.84:46835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 02:42:49.494037 19139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:49.489224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:51881 (local address 127.10.75.126:45733)
0812 02:42:49.489404 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:49.489409 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:49.490673 (+ 1264us) server_negotiation.cc:407] Connection header received
0812 02:42:49.492281 (+ 1608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:49.492284 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:49.492318 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:49.492392 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:49.493618 (+ 1226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:49.493621 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:49.493623 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:42:49.493633 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:49.493650 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:42:49.493658 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:49.493729 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:49.493902 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 02:42:49.493938 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 02:42:49.495066 19668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:49.489597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:45733 (local address 127.10.75.66:51881)
0812 02:42:49.490436 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:49.490490 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:49.492055 (+ 1565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:49.492609 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:49.492619 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:49.492734 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:49.493302 (+ 568us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:42:49.493306 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:49.493361 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:42:49.493448 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:49.493746 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:49.493757 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:49.493766 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 02:42:49.493939 (+ 173us) client_negotiation.cc:240] Negotiation successful
0812 02:42:49.494213 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":153,"threads_started":1}
I20260812 02:42:49.496377 19666 heartbeater.cc:347] Connected to a master server at 127.10.75.126:45733
I20260812 02:42:49.496615 19666 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:49.497007 19666 heartbeater.cc:511] Master 127.10.75.126:45733 requested a full tablet report, sending...
I20260812 02:42:49.498167 19079 ts_manager.cc:194] Registered new tserver with Master: dbb02521b08c4c83bed1f94caa6b64e1 (127.10.75.66:36289)
W20260812 02:42:49.608837 19669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:49.609113 19669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:49.609155 19669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:49.613116 19669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:49.613171 19669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:49.613226 19669 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:42:49.617934 19669 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:46835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:45733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19669
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:49.619140 19669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:49.620524 19669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:49.630033 19678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:49.630053 19677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:49.630048 19682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:49.630496 19669 server_base.cc:1034] running on GCE node
I20260812 02:42:49.630874 19669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:49.631747 19669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:49.632956 19669 hybrid_clock.cc:648] HybridClock initialized: now 1786502569632944 us; error 29 us; skew 500 ppm
I20260812 02:42:49.634775 19669 webserver.cc:460] Webserver started at http://127.10.75.67:45969/ using document root <none> and password file <none>
I20260812 02:42:49.635349 19669 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:49.635442 19669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:49.635681 19669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:49.637673 19669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "42bfd5e8ba3b4598ab44c70de7c00f2f"
format_stamp: "Formatted at 2026-08-12 02:42:49 on dist-test-slave-2p8l"
server_key: "7a9480500486118f7fb0a27301970043"
server_key_iv: "915996a525c16cae3ad4917ef515919e"
server_key_version: "encryptionkey@0"
I20260812 02:42:49.638286 19669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "42bfd5e8ba3b4598ab44c70de7c00f2f"
format_stamp: "Formatted at 2026-08-12 02:42:49 on dist-test-slave-2p8l"
server_key: "7a9480500486118f7fb0a27301970043"
server_key_iv: "915996a525c16cae3ad4917ef515919e"
server_key_version: "encryptionkey@0"
I20260812 02:42:49.641959 19669 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260812 02:42:49.644404 19692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:49.645557 19669 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:42:49.645701 19669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "42bfd5e8ba3b4598ab44c70de7c00f2f"
format_stamp: "Formatted at 2026-08-12 02:42:49 on dist-test-slave-2p8l"
server_key: "7a9480500486118f7fb0a27301970043"
server_key_iv: "915996a525c16cae3ad4917ef515919e"
server_key_version: "encryptionkey@0"
I20260812 02:42:49.645812 19669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:49.650229 19669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:49.650810 19669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:49.650986 19669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:49.651579 19669 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:49.652482 19669 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:49.652539 19669 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:49.652576 19669 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:49.652598 19669 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:49.661355 19669 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:37503
I20260812 02:42:49.661388 19898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:37503 every 8 connection(s)
I20260812 02:42:49.662334 19669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:42:49.668577 19139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:49.664122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:35389 (local address 127.10.75.126:45733)
0812 02:42:49.664291 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:49.664294 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:49.665406 (+ 1112us) server_negotiation.cc:407] Connection header received
0812 02:42:49.666809 (+ 1403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:49.666812 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:49.666855 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:49.666961 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:49.668013 (+ 1052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:49.668019 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:49.668025 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:42:49.668037 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:49.668069 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:42:49.668079 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:49.668181 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:49.668345 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 02:42:49.668394 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 02:42:49.669320 19903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:49.664473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:45733 (local address 127.10.75.67:35389)
0812 02:42:49.665257 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:49.665295 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:49.666601 (+ 1306us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:49.667122 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:49.667128 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:49.667212 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:49.667739 (+ 527us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:42:49.667741 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:49.667779 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:42:49.667844 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:49.668166 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:49.668175 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:49.668181 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 02:42:49.668382 (+ 201us) client_negotiation.cc:240] Negotiation successful
0812 02:42:49.668612 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":143,"threads_started":1}
I20260812 02:42:49.670434 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 19669
I20260812 02:42:49.670519 19900 heartbeater.cc:347] Connected to a master server at 127.10.75.126:45733
I20260812 02:42:49.670586 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:42:49.670746 19900 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:49.670907 10541 external_mini_cluster.cc:1428] Setting key 50beaa7a2eac3ba5559a88592bbd2a69
I20260812 02:42:49.671200 19900 heartbeater.cc:511] Master 127.10.75.126:45733 requested a full tablet report, sending...
I20260812 02:42:49.672322 19079 ts_manager.cc:194] Registered new tserver with Master: 42bfd5e8ba3b4598ab44c70de7c00f2f (127.10.75.67:37503)
I20260812 02:42:49.673079 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:42:49.676546 19139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:49.675241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36370 (local address 127.10.75.126:45733)
0812 02:42:49.675366 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:49.675370 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:49.675488 (+ 118us) server_negotiation.cc:407] Connection header received
0812 02:42:49.675597 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:49.675599 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:49.675626 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:49.675695 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:49.676297 (+ 602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:49.676299 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:49.676301 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:42:49.676311 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:49.676327 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:42:49.676334 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:49.676399 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:49.676436 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 02:42:49.676463 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 02:42:49.679455 19071 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36370:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:42:49.682376 19071 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:42:49.693967 19931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:49.690750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:45033 (local address 127.0.0.1:37654)
0812 02:42:49.691571 (+ 821us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:49.691584 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:49.691670 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:49.692822 (+ 1152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:49.692828 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:49.692843 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:49.693271 (+ 428us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:42:49.693272 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:49.693280 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:42:49.693301 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:49.693648 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:49.693658 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:49.693664 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 02:42:49.693774 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 02:42:49.693839 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":758,"thread_start_us":108,"threads_started":1}
I20260812 02:42:49.694000 19932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:49.691035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37654 (local address 127.10.75.65:45033)
0812 02:42:49.691428 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:49.691439 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:49.691693 (+ 254us) server_negotiation.cc:407] Connection header received
0812 02:42:49.691762 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:49.691767 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:49.691968 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:49.692124 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:49.693429 (+ 1305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:49.693435 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:49.693447 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:42:49.693461 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:49.693504 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:42:49.693532 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:49.693678 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:49.693788 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 02:42:49.693862 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":198,"threads_started":1}
I20260812 02:42:49.694324 19923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:49.690393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:37503 (local address 127.0.0.1:41092)
0812 02:42:49.690856 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:49.690908 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:49.691011 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:49.693051 (+ 2040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:49.693055 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:49.693071 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:49.693476 (+ 405us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:42:49.693478 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:49.693489 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:42:49.693517 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:49.693948 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:49.693951 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:49.693955 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 02:42:49.694022 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 02:42:49.694186 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":125,"thread_start_us":101,"threads_started":1}
I20260812 02:42:49.694478 19924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:49.690492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41092 (local address 127.10.75.67:37503)
0812 02:42:49.692098 (+ 1606us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:49.692108 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:49.692126 (+ 18us) server_negotiation.cc:407] Connection header received
0812 02:42:49.692183 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:49.692189 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:49.692336 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:49.692448 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:49.693733 (+ 1285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:49.693738 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:49.693747 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:42:49.693759 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:49.693794 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:42:49.693825 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:49.693914 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:49.694269 (+ 355us) server_negotiation.cc:299] Negotiation successful
0812 02:42:49.694335 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1518,"thread_start_us":139,"threads_started":1}
I20260812 02:42:49.694687 19934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:49.691245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37354 (local address 127.10.75.66:36289)
0812 02:42:49.691525 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:49.691536 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:49.691882 (+ 346us) server_negotiation.cc:407] Connection header received
0812 02:42:49.691973 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:49.691978 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:49.692150 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:49.692291 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:49.693670 (+ 1379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:49.693679 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:49.693691 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:42:49.693703 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:49.693741 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:42:49.693769 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:49.693875 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:49.694462 (+ 587us) server_negotiation.cc:299] Negotiation successful
0812 02:42:49.694532 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":97,"threads_started":1}
I20260812 02:42:49.694224 19930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:49.691105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:36289 (local address 127.0.0.1:37354)
0812 02:42:49.691765 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:49.691777 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:49.691878 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:49.692321 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:49.692326 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:49.692398 (+ 72us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:49.692941 (+ 543us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:42:49.692945 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:49.692967 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:42:49.693038 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:49.693923 (+ 885us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:49.693930 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:49.693934 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 02:42:49.694011 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 02:42:49.694057 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":141,"threads_started":1}
I20260812 02:42:49.697361 19303 tablet_service.cc:1467] Processing CreateTablet for tablet 38a38395dcb147ae988fdb260ca2a1d5 (DEFAULT_TABLE table=test-table [id=7eb25869a1004085a0b06be6db4db310]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:49.697358 19779 tablet_service.cc:1467] Processing CreateTablet for tablet 38a38395dcb147ae988fdb260ca2a1d5 (DEFAULT_TABLE table=test-table [id=7eb25869a1004085a0b06be6db4db310]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:49.697829 19543 tablet_service.cc:1467] Processing CreateTablet for tablet 38a38395dcb147ae988fdb260ca2a1d5 (DEFAULT_TABLE table=test-table [id=7eb25869a1004085a0b06be6db4db310]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:49.698563 19779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38a38395dcb147ae988fdb260ca2a1d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:49.698565 19303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38a38395dcb147ae988fdb260ca2a1d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:49.698946 19543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38a38395dcb147ae988fdb260ca2a1d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:49.705273 19936 tablet_bootstrap.cc:492] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1: Bootstrap starting.
I20260812 02:42:49.706490 19938 tablet_bootstrap.cc:492] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f: Bootstrap starting.
I20260812 02:42:49.706677 19940 tablet_bootstrap.cc:492] T 38a38395dcb147ae988fdb260ca2a1d5 P ebbeece0148f4c2cb34c9032dcd98089: Bootstrap starting.
I20260812 02:42:49.708017 19936 tablet_bootstrap.cc:654] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:49.708602 19940 tablet_bootstrap.cc:654] T 38a38395dcb147ae988fdb260ca2a1d5 P ebbeece0148f4c2cb34c9032dcd98089: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:49.708607 19938 tablet_bootstrap.cc:654] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:49.708837 19936 log.cc:824] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:49.709476 19940 log.cc:824] T 38a38395dcb147ae988fdb260ca2a1d5 P ebbeece0148f4c2cb34c9032dcd98089: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:49.709476 19938 log.cc:824] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:49.710970 19936 tablet_bootstrap.cc:492] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1: No bootstrap required, opened a new log
I20260812 02:42:49.711210 19936 ts_tablet_manager.cc:1397] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 02:42:49.711611 19940 tablet_bootstrap.cc:492] T 38a38395dcb147ae988fdb260ca2a1d5 P ebbeece0148f4c2cb34c9032dcd98089: No bootstrap required, opened a new log
I20260812 02:42:49.711611 19938 tablet_bootstrap.cc:492] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f: No bootstrap required, opened a new log
I20260812 02:42:49.711814 19940 ts_tablet_manager.cc:1397] T 38a38395dcb147ae988fdb260ca2a1d5 P ebbeece0148f4c2cb34c9032dcd98089: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 02:42:49.711814 19938 ts_tablet_manager.cc:1397] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 02:42:49.715255 19936 raft_consensus.cc:348] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bfd5e8ba3b4598ab44c70de7c00f2f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37503 } } peers { permanent_uuid: "dbb02521b08c4c83bed1f94caa6b64e1" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36289 } } peers { permanent_uuid: "ebbeece0148f4c2cb34c9032dcd98089" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 45033 } }
I20260812 02:42:49.715513 19936 raft_consensus.cc:374] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:49.715570 19936 raft_consensus.cc:729] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbb02521b08c4c83bed1f94caa6b64e1, State: Initialized, Role: FOLLOWER
I20260812 02:42:49.716048 19936 consensus_queue.cc:260] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bfd5e8ba3b4598ab44c70de7c00f2f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37503 } } peers { permanent_uuid: "dbb02521b08c4c83bed1f94caa6b64e1" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36289 } } peers { permanent_uuid: "ebbeece0148f4c2cb34c9032dcd98089" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 45033 } }
I20260812 02:42:49.716255 19940 raft_consensus.cc:348] T 38a38395dcb147ae988fdb260ca2a1d5 P ebbeece0148f4c2cb34c9032dcd98089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bfd5e8ba3b4598ab44c70de7c00f2f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37503 } } peers { permanent_uuid: "dbb02521b08c4c83bed1f94caa6b64e1" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36289 } } peers { permanent_uuid: "ebbeece0148f4c2cb34c9032dcd98089" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 45033 } }
I20260812 02:42:49.716255 19938 raft_consensus.cc:348] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bfd5e8ba3b4598ab44c70de7c00f2f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37503 } } peers { permanent_uuid: "dbb02521b08c4c83bed1f94caa6b64e1" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36289 } } peers { permanent_uuid: "ebbeece0148f4c2cb34c9032dcd98089" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 45033 } }
I20260812 02:42:49.716500 19940 raft_consensus.cc:374] T 38a38395dcb147ae988fdb260ca2a1d5 P ebbeece0148f4c2cb34c9032dcd98089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:49.716500 19938 raft_consensus.cc:374] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:49.716562 19940 raft_consensus.cc:729] T 38a38395dcb147ae988fdb260ca2a1d5 P ebbeece0148f4c2cb34c9032dcd98089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebbeece0148f4c2cb34c9032dcd98089, State: Initialized, Role: FOLLOWER
I20260812 02:42:49.716583 19938 raft_consensus.cc:729] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42bfd5e8ba3b4598ab44c70de7c00f2f, State: Initialized, Role: FOLLOWER
I20260812 02:42:49.716861 19666 heartbeater.cc:503] Master 127.10.75.126:45733 was elected leader, sending a full tablet report...
I20260812 02:42:49.716979 19938 consensus_queue.cc:260] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bfd5e8ba3b4598ab44c70de7c00f2f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37503 } } peers { permanent_uuid: "dbb02521b08c4c83bed1f94caa6b64e1" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36289 } } peers { permanent_uuid: "ebbeece0148f4c2cb34c9032dcd98089" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 45033 } }
I20260812 02:42:49.716979 19940 consensus_queue.cc:260] T 38a38395dcb147ae988fdb260ca2a1d5 P ebbeece0148f4c2cb34c9032dcd98089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bfd5e8ba3b4598ab44c70de7c00f2f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37503 } } peers { permanent_uuid: "dbb02521b08c4c83bed1f94caa6b64e1" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36289 } } peers { permanent_uuid: "ebbeece0148f4c2cb34c9032dcd98089" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 45033 } }
I20260812 02:42:49.717626 19427 heartbeater.cc:503] Master 127.10.75.126:45733 was elected leader, sending a full tablet report...
I20260812 02:42:49.717890 19900 heartbeater.cc:503] Master 127.10.75.126:45733 was elected leader, sending a full tablet report...
I20260812 02:42:49.717947 19940 ts_tablet_manager.cc:1428] T 38a38395dcb147ae988fdb260ca2a1d5 P ebbeece0148f4c2cb34c9032dcd98089: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 02:42:49.718909 19938 ts_tablet_manager.cc:1428] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 02:42:49.719748 19936 ts_tablet_manager.cc:1428] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
W20260812 02:42:49.738381 19667 tablet.cc:2369] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 02:42:49.818374 19428 tablet.cc:2369] T 38a38395dcb147ae988fdb260ca2a1d5 P ebbeece0148f4c2cb34c9032dcd98089: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 02:42:49.913303 19901 tablet.cc:2369] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:42:50.008344 19952 raft_consensus.cc:482] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:42:50.008562 19952 raft_consensus.cc:504] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bfd5e8ba3b4598ab44c70de7c00f2f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37503 } } peers { permanent_uuid: "dbb02521b08c4c83bed1f94caa6b64e1" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36289 } } peers { permanent_uuid: "ebbeece0148f4c2cb34c9032dcd98089" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 45033 } }
I20260812 02:42:50.009747 19952 leader_election.cc:288] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42bfd5e8ba3b4598ab44c70de7c00f2f (127.10.75.67:37503), ebbeece0148f4c2cb34c9032dcd98089 (127.10.75.65:45033)
I20260812 02:42:50.012002 19924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:50.010119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:33245 (local address 127.10.75.67:37503)
0812 02:42:50.010256 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:50.010261 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:50.010445 (+ 184us) server_negotiation.cc:407] Connection header received
0812 02:42:50.010558 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:50.010562 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:50.010607 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:50.010710 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:50.011563 (+ 853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:50.011566 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:50.011569 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:42:50.011583 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:50.011605 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:42:50.011616 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:50.011711 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:50.011817 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 02:42:50.011860 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 02:42:50.012002 19932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:50.010245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:50795 (local address 127.10.75.65:45033)
0812 02:42:50.010385 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:50.010389 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:50.010513 (+ 124us) server_negotiation.cc:407] Connection header received
0812 02:42:50.010592 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:50.010594 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:50.010629 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:50.010710 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:50.011563 (+ 853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:50.011566 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:50.011569 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:42:50.011583 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:50.011605 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:42:50.011616 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:50.011711 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:50.011816 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 02:42:50.011860 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 02:42:50.012053 19956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:50.010121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:45033 (local address 127.10.75.66:50795)
0812 02:42:50.010422 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:50.010435 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:50.010507 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:50.010765 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:50.010769 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:50.010785 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:50.011407 (+ 622us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:42:50.011409 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:50.011416 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:42:50.011433 (+ 17us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:50.011712 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:50.011715 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:50.011718 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 02:42:50.011802 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 02:42:50.011850 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"mutex_wait_us":2,"thread_start_us":73,"threads_started":1}
I20260812 02:42:50.012061 19955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:50.009941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:37503 (local address 127.10.75.66:33245)
0812 02:42:50.010331 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:50.010347 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:50.010461 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:50.010765 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:50.010769 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:50.010785 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:50.011368 (+ 583us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:42:50.011371 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:50.011385 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:42:50.011416 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:50.011712 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:50.011715 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:50.011718 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 02:42:50.011802 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 02:42:50.011844 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":120,"threads_started":1}
I20260812 02:42:50.012756 19818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38a38395dcb147ae988fdb260ca2a1d5" candidate_uuid: "dbb02521b08c4c83bed1f94caa6b64e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bfd5e8ba3b4598ab44c70de7c00f2f" is_pre_election: true
I20260812 02:42:50.012758 19344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38a38395dcb147ae988fdb260ca2a1d5" candidate_uuid: "dbb02521b08c4c83bed1f94caa6b64e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebbeece0148f4c2cb34c9032dcd98089" is_pre_election: true
I20260812 02:42:50.013055 19344 raft_consensus.cc:2454] T 38a38395dcb147ae988fdb260ca2a1d5 P ebbeece0148f4c2cb34c9032dcd98089 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbb02521b08c4c83bed1f94caa6b64e1 in term 0.
I20260812 02:42:50.013055 19818 raft_consensus.cc:2454] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbb02521b08c4c83bed1f94caa6b64e1 in term 0.
I20260812 02:42:50.013520 19462 leader_election.cc:302] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42bfd5e8ba3b4598ab44c70de7c00f2f, dbb02521b08c4c83bed1f94caa6b64e1; no voters:
I20260812 02:42:50.013777 19952 raft_consensus.cc:2781] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:42:50.013861 19952 raft_consensus.cc:482] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:42:50.013906 19952 raft_consensus.cc:3037] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:50.015321 19952 raft_consensus.cc:504] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bfd5e8ba3b4598ab44c70de7c00f2f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37503 } } peers { permanent_uuid: "dbb02521b08c4c83bed1f94caa6b64e1" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36289 } } peers { permanent_uuid: "ebbeece0148f4c2cb34c9032dcd98089" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 45033 } }
I20260812 02:42:50.015785 19952 leader_election.cc:288] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [CANDIDATE]: Term 1 election: Requested vote from peers 42bfd5e8ba3b4598ab44c70de7c00f2f (127.10.75.67:37503), ebbeece0148f4c2cb34c9032dcd98089 (127.10.75.65:45033)
I20260812 02:42:50.016067 19818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38a38395dcb147ae988fdb260ca2a1d5" candidate_uuid: "dbb02521b08c4c83bed1f94caa6b64e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bfd5e8ba3b4598ab44c70de7c00f2f"
I20260812 02:42:50.016225 19818 raft_consensus.cc:3037] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:50.016175 19344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38a38395dcb147ae988fdb260ca2a1d5" candidate_uuid: "dbb02521b08c4c83bed1f94caa6b64e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebbeece0148f4c2cb34c9032dcd98089"
I20260812 02:42:50.016381 19344 raft_consensus.cc:3037] T 38a38395dcb147ae988fdb260ca2a1d5 P ebbeece0148f4c2cb34c9032dcd98089 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:50.017308 19818 raft_consensus.cc:2454] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbb02521b08c4c83bed1f94caa6b64e1 in term 1.
I20260812 02:42:50.017482 19344 raft_consensus.cc:2454] T 38a38395dcb147ae988fdb260ca2a1d5 P ebbeece0148f4c2cb34c9032dcd98089 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbb02521b08c4c83bed1f94caa6b64e1 in term 1.
I20260812 02:42:50.017642 19462 leader_election.cc:302] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42bfd5e8ba3b4598ab44c70de7c00f2f, dbb02521b08c4c83bed1f94caa6b64e1; no voters:
I20260812 02:42:50.017832 19952 raft_consensus.cc:2781] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:50.018126 19952 raft_consensus.cc:686] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [term 1 LEADER]: Becoming Leader. State: Replica: dbb02521b08c4c83bed1f94caa6b64e1, State: Running, Role: LEADER
I20260812 02:42:50.018462 19952 consensus_queue.cc:237] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bfd5e8ba3b4598ab44c70de7c00f2f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37503 } } peers { permanent_uuid: "dbb02521b08c4c83bed1f94caa6b64e1" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36289 } } peers { permanent_uuid: "ebbeece0148f4c2cb34c9032dcd98089" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 45033 } }
I20260812 02:42:50.021595 19071 catalog_manager.cc:5495] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbb02521b08c4c83bed1f94caa6b64e1 (127.10.75.66). New cstate: current_term: 1 leader_uuid: "dbb02521b08c4c83bed1f94caa6b64e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bfd5e8ba3b4598ab44c70de7c00f2f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbb02521b08c4c83bed1f94caa6b64e1" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 36289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebbeece0148f4c2cb34c9032dcd98089" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 45033 } health_report { overall_health: UNKNOWN } } }
I20260812 02:42:50.056131 19934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:50.054491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37366 (local address 127.10.75.66:36289)
0812 02:42:50.054648 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:50.054652 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:50.054667 (+ 15us) server_negotiation.cc:407] Connection header received
0812 02:42:50.054852 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:50.054854 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:50.054913 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:50.055007 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:50.055691 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:50.055694 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:50.055697 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:42:50.055708 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:50.055729 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:42:50.055744 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:50.055833 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:50.055940 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 02:42:50.055984 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 02:42:50.062103 19818 raft_consensus.cc:1261] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f [term 1 FOLLOWER]: Refusing update from remote peer dbb02521b08c4c83bed1f94caa6b64e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:42:50.062096 19344 raft_consensus.cc:1261] T 38a38395dcb147ae988fdb260ca2a1d5 P ebbeece0148f4c2cb34c9032dcd98089 [term 1 FOLLOWER]: Refusing update from remote peer dbb02521b08c4c83bed1f94caa6b64e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:42:50.062889 19958 consensus_queue.cc:1035] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bfd5e8ba3b4598ab44c70de7c00f2f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 37503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:50.063081 19952 consensus_queue.cc:1035] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebbeece0148f4c2cb34c9032dcd98089" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 45033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:50.084729 19079 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:42:50.084899 19079 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:42:50.087473 19079 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 059fab1f54c94997805d671ca25dce94: Sending DeleteTablet for 3 replicas of tablet 38a38395dcb147ae988fdb260ca2a1d5
I20260812 02:42:50.088302 19303 tablet_service.cc:1514] Processing DeleteTablet for tablet 38a38395dcb147ae988fdb260ca2a1d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:50 UTC) from {username='slave'} at 127.0.0.1:37654
I20260812 02:42:50.088351 19543 tablet_service.cc:1514] Processing DeleteTablet for tablet 38a38395dcb147ae988fdb260ca2a1d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:50 UTC) from {username='slave'} at 127.0.0.1:37354
I20260812 02:42:50.088730 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 19177
I20260812 02:42:50.096613 19779 tablet_service.cc:1514] Processing DeleteTablet for tablet 38a38395dcb147ae988fdb260ca2a1d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:50 UTC) from {username='slave'} at 127.0.0.1:41092
I20260812 02:42:50.097096 19987 tablet_replica.cc:330] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1: stopping tablet replica
I20260812 02:42:50.097415 19987 raft_consensus.cc:2229] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:42:50.097784 19987 raft_consensus.cc:2258] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:50.099013 19987 ts_tablet_manager.cc:1905] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:50.101240 19987 ts_tablet_manager.cc:1918] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:42:50.101347 19987 log.cc:1196] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/38a38395dcb147ae988fdb260ca2a1d5
I20260812 02:42:50.101703 19987 ts_tablet_manager.cc:1939] T 38a38395dcb147ae988fdb260ca2a1d5 P dbb02521b08c4c83bed1f94caa6b64e1: Deleting consensus metadata
I20260812 02:42:50.102805 19051 catalog_manager.cc:4841] TS dbb02521b08c4c83bed1f94caa6b64e1 (127.10.75.66:36289): tablet 38a38395dcb147ae988fdb260ca2a1d5 (table test-table [id=7eb25869a1004085a0b06be6db4db310]) successfully deleted
W20260812 02:42:50.104620 19055 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.75.65:45033 (error 108)
I20260812 02:42:50.104761 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 19430
I20260812 02:42:50.105451 19989 tablet_replica.cc:330] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f: stopping tablet replica
I20260812 02:42:50.105764 19989 raft_consensus.cc:2229] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:42:50.106029 19989 raft_consensus.cc:2258] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:50.110531 19931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:50.110198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:45033 (local address 127.0.0.1:37658)
0812 02:42:50.110393 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:50.110456 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.65:45033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
W20260812 02:42:50.110746 19055 catalog_manager.cc:4584] TS ebbeece0148f4c2cb34c9032dcd98089 (127.10.75.65:45033): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 38a38395dcb147ae988fdb260ca2a1d5: Network error: Client connection negotiation failed: client connection to 127.10.75.65:45033: connect: Connection refused (error 111)
I20260812 02:42:50.113059 19989 ts_tablet_manager.cc:1905] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:50.116051 19989 ts_tablet_manager.cc:1918] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:42:50.116137 19989 log.cc:1196] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/38a38395dcb147ae988fdb260ca2a1d5
I20260812 02:42:50.116438 19989 ts_tablet_manager.cc:1939] T 38a38395dcb147ae988fdb260ca2a1d5 P 42bfd5e8ba3b4598ab44c70de7c00f2f: Deleting consensus metadata
I20260812 02:42:50.117239 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 19669
I20260812 02:42:50.129498 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 19027
2026-08-12T02:42:50Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1258 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 02:42:50.158623 10541 mini_oidc.cc:152] Starting JWKS server
I20260812 02:42:50.160280 10541 webserver.cc:460] Webserver started at https://127.0.0.1:38429/ using document root <none> and password file <none>
I20260812 02:42:50.160461 10541 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 02:42:50.160743 10541 webserver.cc:460] Webserver started at http://127.0.0.1:45455/ using document root <none> and password file <none>
2026-08-12T02:42:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:42:50Z Disabled control of system clock
I20260812 02:42:50.170463 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:39901
--webserver_interface=127.10.75.126
--webserver_port=0
--builtin_ntp_servers=127.10.75.84:36345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:39901
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38429/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0/testchainca.cert with env {}
W20260812 02:42:50.281675 20006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:50.281920 20006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:50.281960 20006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:50.286639 20006 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:42:50.286693 20006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:50.286710 20006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:50.286726 20006 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:42:50.286741 20006 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 02:42:50.286757 20006 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 02:42:50.286772 20006 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38429/jwks.json
I20260812 02:42:50.291888 20006 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:39901
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:39901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38429/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:50.292794 20006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:50.293696 20006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:50.302677 20017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:50.302732 20019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:50.302732 20023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:50.302910 20006 server_base.cc:1034] running on GCE node
I20260812 02:42:50.303418 20006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:50.304479 20006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:50.305687 20006 hybrid_clock.cc:648] HybridClock initialized: now 1786502570305663 us; error 41 us; skew 500 ppm
I20260812 02:42:50.307453 20006 webserver.cc:460] Webserver started at http://127.10.75.126:38643/ using document root <none> and password file <none>
I20260812 02:42:50.308010 20006 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:50.308102 20006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:50.308327 20006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:50.310427 20006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "8e82b39d919640478b9954d899982ed3"
format_stamp: "Formatted at 2026-08-12 02:42:50 on dist-test-slave-2p8l"
server_key: "69fd48f6885bd04ed6e3521c9cd9b1ed"
server_key_iv: "bd982e8d79050b0cc638dc4335998080"
server_key_version: "encryptionkey@0"
I20260812 02:42:50.310978 20006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "8e82b39d919640478b9954d899982ed3"
format_stamp: "Formatted at 2026-08-12 02:42:50 on dist-test-slave-2p8l"
server_key: "69fd48f6885bd04ed6e3521c9cd9b1ed"
server_key_iv: "bd982e8d79050b0cc638dc4335998080"
server_key_version: "encryptionkey@0"
I20260812 02:42:50.314487 20006 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 02:42:50.317389 20036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:50.318606 20006 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:42:50.318738 20006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "8e82b39d919640478b9954d899982ed3"
format_stamp: "Formatted at 2026-08-12 02:42:50 on dist-test-slave-2p8l"
server_key: "69fd48f6885bd04ed6e3521c9cd9b1ed"
server_key_iv: "bd982e8d79050b0cc638dc4335998080"
server_key_version: "encryptionkey@0"
I20260812 02:42:50.318840 20006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:50.336962 20006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:50.337651 20006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:50.337852 20006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:50.345472 20006 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:39901
I20260812 02:42:50.345484 20140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:39901 every 8 connection(s)
I20260812 02:42:50.346522 20006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:42:50.349639 20141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:50.354955 20141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3: Bootstrap starting.
I20260812 02:42:50.356236 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 20006
I20260812 02:42:50.356336 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:42:50.356647 10541 external_mini_cluster.cc:1428] Setting key 43d762dca271fa64fcc97836b6f39bc7
I20260812 02:42:50.357601 20141 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:50.358516 20141 log.cc:824] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:50.360699 20141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3: No bootstrap required, opened a new log
I20260812 02:42:50.364898 20141 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e82b39d919640478b9954d899982ed3" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39901 } }
I20260812 02:42:50.365160 20141 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:50.365232 20141 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e82b39d919640478b9954d899982ed3, State: Initialized, Role: FOLLOWER
I20260812 02:42:50.365739 20141 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e82b39d919640478b9954d899982ed3" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39901 } }
I20260812 02:42:50.365871 20141 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:42:50.365962 20141 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:42:50.366106 20141 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:50.366784 20146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:50.357746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43588 (local address 127.10.75.126:39901)
0812 02:42:50.358470 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:50.358489 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:50.358533 (+ 44us) server_negotiation.cc:407] Connection header received
0812 02:42:50.359298 (+ 765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:50.359324 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:50.359713 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:50.360057 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:50.360477 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:50.361940 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:50.362844 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:50.363548 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:50.363733 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:50.364532 (+ 799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:50.364539 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:50.364554 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:42:50.365039 (+ 485us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:50.365109 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:42:50.365137 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:50.365256 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:50.365473 (+ 217us) server_negotiation.cc:299] Negotiation successful
0812 02:42:50.365726 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":115,"threads_started":1}
I20260812 02:42:50.367372 20141 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e82b39d919640478b9954d899982ed3" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39901 } }
I20260812 02:42:50.367707 20141 leader_election.cc:302] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e82b39d919640478b9954d899982ed3; no voters:
I20260812 02:42:50.368038 20141 leader_election.cc:288] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:42:50.368117 20150 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:50.368301 20150 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3 [term 1 LEADER]: Becoming Leader. State: Replica: 8e82b39d919640478b9954d899982ed3, State: Running, Role: LEADER
I20260812 02:42:50.368585 20150 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e82b39d919640478b9954d899982ed3" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39901 } }
I20260812 02:42:50.369277 20141 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:42:50.369724 20150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e82b39d919640478b9954d899982ed3. Latest consensus state: current_term: 1 leader_uuid: "8e82b39d919640478b9954d899982ed3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e82b39d919640478b9954d899982ed3" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39901 } } }
I20260812 02:42:50.369844 20150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:50.369959 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:42:50.370503 20154 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e82b39d919640478b9954d899982ed3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e82b39d919640478b9954d899982ed3" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39901 } } }
I20260812 02:42:50.370602 20154 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:50.370873 20161 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:42:50.374179 20161 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:42:50.379572 20161 catalog_manager.cc:1347] Generated new cluster ID: 3f3b0e1a713f468a939b0e5b8814de69
I20260812 02:42:50.379638 20161 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:42:50.395525 20161 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:42:50.396375 20161 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:42:50.403544 20161 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e82b39d919640478b9954d899982ed3: Generated new TSK 0
I20260812 02:42:50.404243 20161 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 02:42:50.434690 20207 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 02:42:50.434862 20207 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 02:42:50.435423 20146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:50.417625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43602 (local address 127.10.75.126:39901)
0812 02:42:50.417764 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:50.417769 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:50.417963 (+ 194us) server_negotiation.cc:407] Connection header received
0812 02:42:50.418220 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:50.418223 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:50.418281 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:50.418392 (+ 111us) server_negotiation.cc:226] Negotiated authn=JWT
0812 02:42:50.418645 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:50.419506 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:50.420423 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:50.420779 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:50.420888 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:50.421210 (+ 322us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 02:42:50.435006 (+ 13796us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38429/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 02:42:50.435280 (+ 274us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43602: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38429/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":52}
W20260812 02:42:50.435505 20146 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43602: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38429/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260812 02:42:50.436695 20202 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:42:50.417470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:39901 (local address 127.0.0.1:43602)
0812 02:42:50.417877 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:50.417890 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:50.418001 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:50.418414 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:50.418417 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:50.418424 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0812 02:42:50.418533 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:50.418538 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:50.419641 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:50.419644 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:50.420295 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:50.420303 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:50.420896 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:50.420899 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:50.420966 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:50.421009 (+ 43us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 02:42:50.435222 (+ 14213us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38429/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 02:42:50.435419 (+ 197us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.75.126:39901: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38429/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":132,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.10.75.126:39901: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38429/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 02:42:50.437481 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 20006
2026-08-12T02:42:50Z chronyd exiting
I20260812 02:42:50.487746 10541 test_util.cc:175] -----------------------------------------------
I20260812 02:42:50.487851 10541 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786502539688512-10541-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (330 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 02:42:50.488981 10541 mini_oidc.cc:152] Starting JWKS server
I20260812 02:42:50.489850 10541 webserver.cc:460] Webserver started at https://127.0.0.1:34067/ using document root <none> and password file <none>
I20260812 02:42:50.489982 10541 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 02:42:50.490314 10541 webserver.cc:460] Webserver started at http://127.0.0.1:42873/ using document root <none> and password file <none>
2026-08-12T02:42:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:42:50Z Disabled control of system clock
I20260812 02:42:50.500589 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:38283
--webserver_interface=127.10.75.126
--webserver_port=0
--builtin_ntp_servers=127.10.75.84:39187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:38283
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34067/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786502539688512-10541-0/testchainca.cert with env {}
W20260812 02:42:50.610512 20217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:50.610790 20217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:50.610860 20217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:50.614826 20217 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:42:50.614898 20217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:50.614928 20217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:50.614987 20217 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:42:50.615024 20217 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 02:42:50.615060 20217 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 02:42:50.615087 20217 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34067/jwks.json
I20260812 02:42:50.620240 20217 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:39187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:38283
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:38283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34067/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786502539688512-10541-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:50.621222 20217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:50.622285 20217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:50.630730 20223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:50.630709 20228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:50.630750 20224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:50.630956 20217 server_base.cc:1034] running on GCE node
I20260812 02:42:50.631597 20217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:50.632623 20217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:50.633812 20217 hybrid_clock.cc:648] HybridClock initialized: now 1786502570633785 us; error 39 us; skew 500 ppm
I20260812 02:42:50.635608 20217 webserver.cc:460] Webserver started at http://127.10.75.126:42703/ using document root <none> and password file <none>
I20260812 02:42:50.636165 20217 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:50.636258 20217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:50.636484 20217 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:50.638499 20217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "3f19090172fb4f8e813a8ccbec5c5adf"
format_stamp: "Formatted at 2026-08-12 02:42:50 on dist-test-slave-2p8l"
server_key: "31b12211a74837718e1bd50e015caef3"
server_key_iv: "f510e7979c99dfb5ea84f486fadecb55"
server_key_version: "encryptionkey@0"
I20260812 02:42:50.639045 20217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "3f19090172fb4f8e813a8ccbec5c5adf"
format_stamp: "Formatted at 2026-08-12 02:42:50 on dist-test-slave-2p8l"
server_key: "31b12211a74837718e1bd50e015caef3"
server_key_iv: "f510e7979c99dfb5ea84f486fadecb55"
server_key_version: "encryptionkey@0"
I20260812 02:42:50.642472 20217 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 02:42:50.644783 20239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:50.645880 20217 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:42:50.646032 20217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "3f19090172fb4f8e813a8ccbec5c5adf"
format_stamp: "Formatted at 2026-08-12 02:42:50 on dist-test-slave-2p8l"
server_key: "31b12211a74837718e1bd50e015caef3"
server_key_iv: "f510e7979c99dfb5ea84f486fadecb55"
server_key_version: "encryptionkey@0"
I20260812 02:42:50.646224 20217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:50.663774 20217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:50.664412 20217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:50.664625 20217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:50.671571 20217 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:38283
I20260812 02:42:50.671581 20330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:38283 every 8 connection(s)
I20260812 02:42:50.672482 20217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:42:50.675575 20333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:50.676169 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 20217
I20260812 02:42:50.676295 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:42:50.676597 10541 external_mini_cluster.cc:1428] Setting key 1b9b083b8d621d5ba431ff242b7684d9
I20260812 02:42:50.681497 20333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf: Bootstrap starting.
I20260812 02:42:50.683825 20333 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:50.684561 20333 log.cc:824] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:50.685777 20339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:50.677995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43654 (local address 127.10.75.126:38283)
0812 02:42:50.678679 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:50.678693 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:50.678727 (+ 34us) server_negotiation.cc:407] Connection header received
0812 02:42:50.679367 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:50.679382 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:50.679756 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:50.680080 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:50.680490 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:50.681410 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:50.682416 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:50.682882 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:50.683062 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:50.683948 (+ 886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:50.683955 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:50.683972 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:42:50.684352 (+ 380us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:50.684407 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:42:50.684427 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:50.684553 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:50.684704 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 02:42:50.684964 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":139,"threads_started":1}
I20260812 02:42:50.686695 20333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf: No bootstrap required, opened a new log
I20260812 02:42:50.688612 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:42:50.690631 20333 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f19090172fb4f8e813a8ccbec5c5adf" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 38283 } }
I20260812 02:42:50.690830 20333 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:50.690912 20333 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f19090172fb4f8e813a8ccbec5c5adf, State: Initialized, Role: FOLLOWER
I20260812 02:42:50.691354 20333 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f19090172fb4f8e813a8ccbec5c5adf" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 38283 } }
I20260812 02:42:50.691517 20333 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:42:50.691617 20333 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:42:50.691741 20333 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:50.692626 20333 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f19090172fb4f8e813a8ccbec5c5adf" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 38283 } }
I20260812 02:42:50.692953 20333 leader_election.cc:302] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f19090172fb4f8e813a8ccbec5c5adf; no voters:
I20260812 02:42:50.693270 20333 leader_election.cc:288] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:42:50.693347 20342 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:50.693660 20342 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf [term 1 LEADER]: Becoming Leader. State: Replica: 3f19090172fb4f8e813a8ccbec5c5adf, State: Running, Role: LEADER
I20260812 02:42:50.693948 20342 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f19090172fb4f8e813a8ccbec5c5adf" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 38283 } }
I20260812 02:42:50.694489 20333 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:42:50.695601 20345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f19090172fb4f8e813a8ccbec5c5adf. Latest consensus state: current_term: 1 leader_uuid: "3f19090172fb4f8e813a8ccbec5c5adf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f19090172fb4f8e813a8ccbec5c5adf" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 38283 } } }
I20260812 02:42:50.695724 20345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:50.696059 20344 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f19090172fb4f8e813a8ccbec5c5adf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f19090172fb4f8e813a8ccbec5c5adf" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 38283 } } }
I20260812 02:42:50.696249 20344 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:50.696923 20360 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:42:50.699574 20360 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:42:50.704475 20360 catalog_manager.cc:1347] Generated new cluster ID: 8bdac05ca5c845c58929da68bf2078b2
I20260812 02:42:50.704553 20360 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:42:50.746471 20360 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:42:50.747406 20360 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:42:50.759183 20360 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f19090172fb4f8e813a8ccbec5c5adf: Generated new TSK 0
I20260812 02:42:50.759841 20360 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 02:42:50.789480 20386 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 02:42:50.789597 20386 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 02:42:50.790269 20339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:50.774328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43664 (local address 127.10.75.126:38283)
0812 02:42:50.774468 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:50.774473 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:50.774617 (+ 144us) server_negotiation.cc:407] Connection header received
0812 02:42:50.774743 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:50.774746 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:50.774802 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:50.774917 (+ 115us) server_negotiation.cc:226] Negotiated authn=JWT
0812 02:42:50.775137 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:50.775938 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:50.777182 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:50.777520 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:50.777640 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:50.777914 (+ 274us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 02:42:50.789826 (+ 11912us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34067/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 02:42:50.790129 (+ 303us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43664: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34067/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":58}
W20260812 02:42:50.790340 20339 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43664: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34067/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260812 02:42:50.790450 20385 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:42:50.774220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:38283 (local address 127.0.0.1:43664)
0812 02:42:50.774527 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:50.774540 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:50.774636 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:50.774919 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:50.774921 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:50.774927 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0812 02:42:50.775029 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:50.775033 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:50.776094 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:50.776097 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:50.777049 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:50.777060 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:50.777644 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:50.777647 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:50.777719 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:50.777741 (+ 22us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 02:42:50.790047 (+ 12306us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34067/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 02:42:50.790255 (+ 208us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.75.126:38283: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34067/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":101,"threads_started":1}
I20260812 02:42:50.791028 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 20217
2026-08-12T02:42:50Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (347 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 02:42:50.836831 10541 mini_oidc.cc:152] Starting JWKS server
I20260812 02:42:50.837716 10541 webserver.cc:460] Webserver started at https://127.0.0.1:32881/ using document root <none> and password file <none>
I20260812 02:42:50.837849 10541 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 02:42:50.838184 10541 webserver.cc:460] Webserver started at http://127.0.0.1:42879/ using document root <none> and password file <none>
2026-08-12T02:42:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:42:50Z Disabled control of system clock
I20260812 02:42:50.848305 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:45783
--webserver_interface=127.10.75.126
--webserver_port=0
--builtin_ntp_servers=127.10.75.84:35217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:45783
--enable_jwt_token_auth=true
--jwks_url=https://localhost:32881/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 02:42:50.960011 20401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:50.960250 20401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:50.960317 20401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:50.964278 20401 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:42:50.964329 20401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:50.964345 20401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:50.964396 20401 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:42:50.964428 20401 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 02:42:50.964462 20401 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 02:42:50.964532 20401 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:32881/jwks.json
I20260812 02:42:50.969252 20401 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:35217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:45783
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:45783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:32881/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:50.970325 20401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:50.971684 20401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:50.979879 20413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:50.979879 20409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:50.979954 20411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:50.980316 20401 server_base.cc:1034] running on GCE node
I20260812 02:42:50.980849 20401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:50.981918 20401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:50.983110 20401 hybrid_clock.cc:648] HybridClock initialized: now 1786502570983096 us; error 35 us; skew 500 ppm
I20260812 02:42:50.985046 20401 webserver.cc:460] Webserver started at http://127.10.75.126:42067/ using document root <none> and password file <none>
I20260812 02:42:50.985622 20401 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:50.985719 20401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:50.985954 20401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:50.987984 20401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "f85f5537ec2e40d59dfc102d6d154216"
format_stamp: "Formatted at 2026-08-12 02:42:50 on dist-test-slave-2p8l"
server_key: "712559fd147f7452b0eb8a7363945659"
server_key_iv: "b3baa68369660edd3a491ce65df86a68"
server_key_version: "encryptionkey@0"
I20260812 02:42:50.988569 20401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "f85f5537ec2e40d59dfc102d6d154216"
format_stamp: "Formatted at 2026-08-12 02:42:50 on dist-test-slave-2p8l"
server_key: "712559fd147f7452b0eb8a7363945659"
server_key_iv: "b3baa68369660edd3a491ce65df86a68"
server_key_version: "encryptionkey@0"
I20260812 02:42:50.992261 20401 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 02:42:50.994637 20421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:50.995833 20401 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:50.995991 20401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "f85f5537ec2e40d59dfc102d6d154216"
format_stamp: "Formatted at 2026-08-12 02:42:50 on dist-test-slave-2p8l"
server_key: "712559fd147f7452b0eb8a7363945659"
server_key_iv: "b3baa68369660edd3a491ce65df86a68"
server_key_version: "encryptionkey@0"
I20260812 02:42:50.996109 20401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:51.012398 20401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:51.013031 20401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:51.013252 20401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:51.020278 20401 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:45783
I20260812 02:42:51.020315 20518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:45783 every 8 connection(s)
I20260812 02:42:51.021183 20401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:42:51.024066 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 20401
I20260812 02:42:51.024206 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:42:51.024268 20519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:51.024518 10541 external_mini_cluster.cc:1428] Setting key 5b0f73d73e555e789ac1a05949be7c73
I20260812 02:42:51.030704 20519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216: Bootstrap starting.
I20260812 02:42:51.033219 20519 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:51.033756 20525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:51.025788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38398 (local address 127.10.75.126:45783)
0812 02:42:51.026387 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:51.026403 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:51.026438 (+ 35us) server_negotiation.cc:407] Connection header received
0812 02:42:51.027296 (+ 858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:51.027314 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:51.027682 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:51.027998 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:51.028400 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:51.029333 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:51.030535 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:51.031033 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:51.031174 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:51.032014 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:51.032019 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:51.032030 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:42:51.032398 (+ 368us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:51.032452 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:42:51.032471 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:51.032547 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:51.032717 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 02:42:51.033000 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":125,"threads_started":1}
I20260812 02:42:51.034025 20519 log.cc:824] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:51.036094 20519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216: No bootstrap required, opened a new log
I20260812 02:42:51.036484 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:42:51.039773 20519 raft_consensus.cc:348] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f85f5537ec2e40d59dfc102d6d154216" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 45783 } }
I20260812 02:42:51.039973 20519 raft_consensus.cc:374] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:51.040078 20519 raft_consensus.cc:729] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85f5537ec2e40d59dfc102d6d154216, State: Initialized, Role: FOLLOWER
I20260812 02:42:51.040514 20519 consensus_queue.cc:260] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f85f5537ec2e40d59dfc102d6d154216" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 45783 } }
I20260812 02:42:51.040663 20519 raft_consensus.cc:388] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:42:51.040750 20519 raft_consensus.cc:482] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:42:51.040868 20519 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:51.041736 20519 raft_consensus.cc:504] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f85f5537ec2e40d59dfc102d6d154216" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 45783 } }
I20260812 02:42:51.042107 20519 leader_election.cc:302] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f85f5537ec2e40d59dfc102d6d154216; no voters:
I20260812 02:42:51.042425 20519 leader_election.cc:288] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:42:51.042557 20528 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:51.042801 20528 raft_consensus.cc:686] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216 [term 1 LEADER]: Becoming Leader. State: Replica: f85f5537ec2e40d59dfc102d6d154216, State: Running, Role: LEADER
I20260812 02:42:51.043121 20528 consensus_queue.cc:237] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f85f5537ec2e40d59dfc102d6d154216" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 45783 } }
I20260812 02:42:51.043628 20519 sys_catalog.cc:564] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:42:51.044782 20530 sys_catalog.cc:455] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f85f5537ec2e40d59dfc102d6d154216. Latest consensus state: current_term: 1 leader_uuid: "f85f5537ec2e40d59dfc102d6d154216" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f85f5537ec2e40d59dfc102d6d154216" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 45783 } } }
I20260812 02:42:51.044916 20530 sys_catalog.cc:458] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:51.045328 20540 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:42:51.045306 20529 sys_catalog.cc:455] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f85f5537ec2e40d59dfc102d6d154216" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f85f5537ec2e40d59dfc102d6d154216" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 45783 } } }
I20260812 02:42:51.045898 20529 sys_catalog.cc:458] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:51.048457 20540 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:42:51.054893 20540 catalog_manager.cc:1347] Generated new cluster ID: 98c74d4c6c214ca5a370cd91febf52ed
I20260812 02:42:51.054950 20540 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:42:51.070454 20540 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:42:51.071352 20540 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:42:51.075230 20540 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f85f5537ec2e40d59dfc102d6d154216: Generated new TSK 0
I20260812 02:42:51.075841 20540 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:42:51.093530 20525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:51.088901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38404 (local address 127.10.75.126:45783)
0812 02:42:51.089035 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:51.089040 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:51.089214 (+ 174us) server_negotiation.cc:407] Connection header received
0812 02:42:51.089409 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:51.089412 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:51.089459 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:51.089574 (+ 115us) server_negotiation.cc:226] Negotiated authn=JWT
0812 02:42:51.089827 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:51.090438 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:51.091344 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:51.091581 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:51.091703 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:51.092025 (+ 322us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 02:42:51.093147 (+ 1122us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32881/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 02:42:51.093393 (+ 246us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38404: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32881/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":50}
W20260812 02:42:51.093606 20525 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38404: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32881/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260812 02:42:51.093617 20575 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:42:51.088805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:45783 (local address 127.0.0.1:38404)
0812 02:42:51.089120 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:51.089132 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:51.089264 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:51.089575 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:51.089579 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:51.089587 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0812 02:42:51.089710 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:51.089722 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:51.090561 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:51.090565 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:51.091217 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:51.091225 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:51.091720 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:51.091724 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:51.091814 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:51.091843 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 02:42:51.093308 (+ 1465us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32881/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 02:42:51.093448 (+ 140us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.75.126:45783: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32881/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":115,"threads_started":1}
I20260812 02:42:51.094285 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 20401
E20260812 02:42:51.114902 20578 webserver.cc:533] Webserver: sslize failed:
E20260812 02:42:51.114992 20578 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-12T02:42:51Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (309 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T02:42:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:42:51Z Disabled control of system clock
I20260812 02:42:51.156692 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:38479
--webserver_interface=127.10.75.126
--webserver_port=0
--builtin_ntp_servers=127.10.75.84:45667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:38479
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786502539688512-10541-0/testchainca.cert with env {}
W20260812 02:42:51.267387 20587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:51.267644 20587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:51.267683 20587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:51.271589 20587 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:42:51.271638 20587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:51.271653 20587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:51.271670 20587 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:42:51.271685 20587 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 02:42:51.271700 20587 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 02:42:51.271713 20587 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 02:42:51.276783 20587 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:45667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:38479
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:38479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786502539688512-10541-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:51.277716 20587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:51.278719 20587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:51.287098 20595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:51.287154 20596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:51.287317 20587 server_base.cc:1034] running on GCE node
W20260812 02:42:51.287101 20602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:51.287894 20587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:51.288995 20587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:51.290176 20587 hybrid_clock.cc:648] HybridClock initialized: now 1786502571290157 us; error 30 us; skew 500 ppm
I20260812 02:42:51.292024 20587 webserver.cc:460] Webserver started at http://127.10.75.126:40465/ using document root <none> and password file <none>
I20260812 02:42:51.292579 20587 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:51.292680 20587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:51.292910 20587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:51.294955 20587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "4d678f81d153478fa0346541cdb84762"
format_stamp: "Formatted at 2026-08-12 02:42:51 on dist-test-slave-2p8l"
server_key: "0230545fa27cd50ac1d1c14845b0a47b"
server_key_iv: "ab10362ae9ab43a3c774d75a11d3dbbe"
server_key_version: "encryptionkey@0"
I20260812 02:42:51.295511 20587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "4d678f81d153478fa0346541cdb84762"
format_stamp: "Formatted at 2026-08-12 02:42:51 on dist-test-slave-2p8l"
server_key: "0230545fa27cd50ac1d1c14845b0a47b"
server_key_iv: "ab10362ae9ab43a3c774d75a11d3dbbe"
server_key_version: "encryptionkey@0"
I20260812 02:42:51.299113 20587 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 02:42:51.301435 20610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:51.302677 20587 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:51.302814 20587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "4d678f81d153478fa0346541cdb84762"
format_stamp: "Formatted at 2026-08-12 02:42:51 on dist-test-slave-2p8l"
server_key: "0230545fa27cd50ac1d1c14845b0a47b"
server_key_iv: "ab10362ae9ab43a3c774d75a11d3dbbe"
server_key_version: "encryptionkey@0"
I20260812 02:42:51.302925 20587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:51.315526 20587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:51.316152 20587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:51.316347 20587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:51.323637 20587 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:38479
I20260812 02:42:51.323657 20694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:38479 every 8 connection(s)
I20260812 02:42:51.324601 20587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:42:51.327618 20695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:51.332593 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 20587
I20260812 02:42:51.332732 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:42:51.333040 10541 external_mini_cluster.cc:1428] Setting key 281a7e758856ff20ebfbeb626f9a8e51
I20260812 02:42:51.333442 20695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762: Bootstrap starting.
I20260812 02:42:51.336012 20695 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:51.336766 20695 log.cc:824] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:51.338795 20695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762: No bootstrap required, opened a new log
I20260812 02:42:51.342489 20702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:51.334536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35494 (local address 127.10.75.126:38479)
0812 02:42:51.335216 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:51.335230 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:51.335264 (+ 34us) server_negotiation.cc:407] Connection header received
0812 02:42:51.335888 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:51.335905 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:51.336332 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:51.336657 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:51.337073 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:51.338260 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:51.339204 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:51.339664 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:51.339852 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:51.340727 (+ 875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:51.340733 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:51.340745 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:42:51.341102 (+ 357us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:51.341153 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:42:51.341183 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:51.341291 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:51.341446 (+ 155us) server_negotiation.cc:299] Negotiation successful
0812 02:42:51.341717 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":153,"threads_started":1}
I20260812 02:42:51.342888 20695 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d678f81d153478fa0346541cdb84762" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 38479 } }
I20260812 02:42:51.343146 20695 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:51.343237 20695 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d678f81d153478fa0346541cdb84762, State: Initialized, Role: FOLLOWER
I20260812 02:42:51.343639 20695 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d678f81d153478fa0346541cdb84762" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 38479 } }
I20260812 02:42:51.343787 20695 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:42:51.343874 20695 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:42:51.343992 20695 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:51.345229 20695 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d678f81d153478fa0346541cdb84762" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 38479 } }
I20260812 02:42:51.345569 20695 leader_election.cc:302] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d678f81d153478fa0346541cdb84762; no voters:
I20260812 02:42:51.345675 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:42:51.345919 20695 leader_election.cc:288] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:42:51.346037 20704 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:51.346299 20704 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762 [term 1 LEADER]: Becoming Leader. State: Replica: 4d678f81d153478fa0346541cdb84762, State: Running, Role: LEADER
I20260812 02:42:51.346601 20704 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d678f81d153478fa0346541cdb84762" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 38479 } }
I20260812 02:42:51.347301 20695 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:42:51.348484 20708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d678f81d153478fa0346541cdb84762" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d678f81d153478fa0346541cdb84762" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 38479 } } }
I20260812 02:42:51.348626 20708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:51.348891 20707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d678f81d153478fa0346541cdb84762. Latest consensus state: current_term: 1 leader_uuid: "4d678f81d153478fa0346541cdb84762" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d678f81d153478fa0346541cdb84762" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 38479 } } }
I20260812 02:42:51.348981 20707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:51.349112 20725 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:42:51.351830 20725 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:42:51.357039 20725 catalog_manager.cc:1347] Generated new cluster ID: 468b245cfd034832b4ad1c416be44d09
I20260812 02:42:51.357110 20725 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:42:51.364655 20725 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:42:51.365773 20725 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:42:51.378921 20725 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d678f81d153478fa0346541cdb84762: Generated new TSK 0
I20260812 02:42:51.379562 20725 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:42:51.586153 20702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:51.395486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35510 (local address 127.10.75.126:38479)
0812 02:42:51.395634 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:51.395639 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:51.395833 (+ 194us) server_negotiation.cc:407] Connection header received
0812 02:42:51.395991 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:51.395993 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:51.396038 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:51.396124 (+ 86us) server_negotiation.cc:226] Negotiated authn=JWT
0812 02:42:51.396383 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:51.396900 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:51.398145 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:51.398366 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:51.398442 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:51.398791 (+ 349us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 02:42:51.585678 (+186887us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 02:42:51.585966 (+ 288us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35510: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":64}
W20260812 02:42:51.586264 20702 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35510: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260812 02:42:51.586724 20752 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:42:51.395426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:38479 (local address 127.0.0.1:35510)
0812 02:42:51.395739 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:51.395754 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:51.395874 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:51.396149 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:51.396152 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:51.396161 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0812 02:42:51.396282 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:51.396288 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:51.397007 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:51.397011 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:51.397995 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:51.398005 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:51.398491 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:51.398496 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:51.398602 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:51.398634 (+ 32us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 02:42:51.585938 (+187304us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 02:42:51.586220 (+ 282us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.75.126:38479: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":126,"threads_started":1}
I20260812 02:42:51.587385 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 20587
2026-08-12T02:42:51Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (472 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (132 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (126 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:42:51 dist-test-slave-2p8l krb5kdc[20773](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:42:51 dist-test-slave-2p8l krb5kdc[20773](info): set up 2 sockets
Aug 12 02:42:51 dist-test-slave-2p8l krb5kdc[20773](info): commencing operation
krb5kdc: starting...
W20260812 02:42:53.166316 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:42:53 dist-test-slave-2p8l krb5kdc[20773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:42:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:42:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:42:53.298219 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:46239
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:46239
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:53.412151 20801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:53.412472 20801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:53.412554 20801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:53.416620 20801 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:42:53.416709 20801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:53.416744 20801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:53.416783 20801 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:42:53.416819 20801 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:42:53.423688 20801 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:46239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:46239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:53.424762 20801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:53.425774 20801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:53.434211 20818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:53.434273 20816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:53.434307 20801 server_base.cc:1034] running on GCE node
W20260812 02:42:53.434393 20815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:53.435014 20801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:53.435992 20801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:53.437158 20801 hybrid_clock.cc:648] HybridClock initialized: now 1786502573437133 us; error 31 us; skew 500 ppm
Aug 12 02:42:53 dist-test-slave-2p8l krb5kdc[20773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502573, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:53.443253 20801 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:42:53.444109 20801 webserver.cc:460] Webserver started at http://127.10.75.126:33903/ using document root <none> and password file <none>
I20260812 02:42:53.444741 20801 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:53.444833 20801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:53.445065 20801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:53.447134 20801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "4b9f5766548842e4be468a1322c4e403"
format_stamp: "Formatted at 2026-08-12 02:42:53 on dist-test-slave-2p8l"
server_key: "590adfc27cf223fbac28a4e22b3a8c3b"
server_key_iv: "d9201c7db5da82a000e172d766108837"
server_key_version: "encryptionkey@0"
I20260812 02:42:53.447703 20801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "4b9f5766548842e4be468a1322c4e403"
format_stamp: "Formatted at 2026-08-12 02:42:53 on dist-test-slave-2p8l"
server_key: "590adfc27cf223fbac28a4e22b3a8c3b"
server_key_iv: "d9201c7db5da82a000e172d766108837"
server_key_version: "encryptionkey@0"
I20260812 02:42:53.451359 20801 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 02:42:53.453686 20837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:53.454926 20801 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:53.455075 20801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "4b9f5766548842e4be468a1322c4e403"
format_stamp: "Formatted at 2026-08-12 02:42:53 on dist-test-slave-2p8l"
server_key: "590adfc27cf223fbac28a4e22b3a8c3b"
server_key_iv: "d9201c7db5da82a000e172d766108837"
server_key_version: "encryptionkey@0"
I20260812 02:42:53.455199 20801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:53.492816 20801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:53.495839 20801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:53.496057 20801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:53.503535 20801 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:46239
I20260812 02:42:53.503561 20937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:46239 every 8 connection(s)
I20260812 02:42:53.504477 20801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:42:53.505507 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 20801
I20260812 02:42:53.505607 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:42:53.505905 10541 external_mini_cluster.cc:1428] Setting key 7320f5e856d809d186028ec80110a611
I20260812 02:42:53.507676 20938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:53.514513 20938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403: Bootstrap starting.
Aug 12 02:42:53 dist-test-slave-2p8l krb5kdc[20773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:53.517241 20938 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:53.517973 20938 log.cc:824] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:53.520272 20938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403: No bootstrap required, opened a new log
I20260812 02:42:53.520906 20944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:53.507375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55166 (local address 127.10.75.126:46239)
0812 02:42:53.507807 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:53.507831 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:53.507873 (+ 42us) server_negotiation.cc:407] Connection header received
0812 02:42:53.508696 (+ 823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:53.508718 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:53.509130 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:53.509488 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:53.510221 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:53.511721 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:53.512571 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:53.513268 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:53.513439 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:53.516234 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:53.516239 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:53.516251 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:53.516277 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:53.517967 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:53.518516 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:53.518523 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:53.518528 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:53.518670 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:53.519000 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:53.519003 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:53.519004 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:53.519374 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:53.519518 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:53.519840 (+ 322us) server_negotiation.cc:299] Negotiation successful
0812 02:42:53.520164 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":121,"threads_started":1}
I20260812 02:42:53.524173 20938 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b9f5766548842e4be468a1322c4e403" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 46239 } }
I20260812 02:42:53.524413 20938 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:53.524508 20938 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9f5766548842e4be468a1322c4e403, State: Initialized, Role: FOLLOWER
I20260812 02:42:53.524919 20938 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b9f5766548842e4be468a1322c4e403" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 46239 } }
I20260812 02:42:53.525080 20938 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:42:53.525168 20938 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:42:53.525288 20938 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:53.526238 20938 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b9f5766548842e4be468a1322c4e403" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 46239 } }
I20260812 02:42:53.526602 20938 leader_election.cc:302] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b9f5766548842e4be468a1322c4e403; no voters:
I20260812 02:42:53.526960 20938 leader_election.cc:288] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:42:53.527096 20946 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:53.527351 20946 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403 [term 1 LEADER]: Becoming Leader. State: Replica: 4b9f5766548842e4be468a1322c4e403, State: Running, Role: LEADER
I20260812 02:42:53.527791 20946 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b9f5766548842e4be468a1322c4e403" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 46239 } }
I20260812 02:42:53.528157 20938 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:42:53.529480 20951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b9f5766548842e4be468a1322c4e403. Latest consensus state: current_term: 1 leader_uuid: "4b9f5766548842e4be468a1322c4e403" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b9f5766548842e4be468a1322c4e403" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 46239 } } }
I20260812 02:42:53.529601 20951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:53.529542 20949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b9f5766548842e4be468a1322c4e403" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b9f5766548842e4be468a1322c4e403" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 46239 } } }
I20260812 02:42:53.529673 20949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:53.529971 20967 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:42:53.533525 20967 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:42:53.538699 20967 catalog_manager.cc:1347] Generated new cluster ID: a3bccd0e02ad444f90f13f4c29949584
I20260812 02:42:53.538765 20967 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:42:53.549196 20967 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:42:53.550503 20967 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:42:53.557551 20967 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b9f5766548842e4be468a1322c4e403: Generated new TSK 0
I20260812 02:42:53.558290 20967 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
I20260812 02:42:53.590993 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:46239
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:53.705025 20995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:53.705292 20995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:53.705343 20995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:53.709424 20995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:53.709501 20995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:53.709565 20995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:42:53.714953 20995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:46239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:53.716156 20995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:53.717334 20995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:53.726888 21011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:53.727162 20995 server_base.cc:1034] running on GCE node
W20260812 02:42:53.726902 21017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:53.726888 21013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:53.727766 20995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:53.728394 20995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:53.729564 20995 hybrid_clock.cc:648] HybridClock initialized: now 1786502573729532 us; error 43 us; skew 500 ppm
Aug 12 02:42:53 dist-test-slave-2p8l krb5kdc[20773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502573, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:53.732410 20995 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:42:53.733311 20995 webserver.cc:460] Webserver started at http://127.10.75.65:45267/ using document root <none> and password file <none>
I20260812 02:42:53.733870 20995 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:53.733930 20995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:53.734203 20995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:53.736250 20995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "73816f4ab5f84d2b85720a7956f4c199"
format_stamp: "Formatted at 2026-08-12 02:42:53 on dist-test-slave-2p8l"
server_key: "9864c325afa8d7eeba525ee16fb446e4"
server_key_iv: "b212a70148ecdb0e5395b7d4c74f925e"
server_key_version: "encryptionkey@0"
I20260812 02:42:53.736864 20995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "73816f4ab5f84d2b85720a7956f4c199"
format_stamp: "Formatted at 2026-08-12 02:42:53 on dist-test-slave-2p8l"
server_key: "9864c325afa8d7eeba525ee16fb446e4"
server_key_iv: "b212a70148ecdb0e5395b7d4c74f925e"
server_key_version: "encryptionkey@0"
I20260812 02:42:53.740499 20995 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260812 02:42:53.742905 21032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:53.744108 20995 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 02:42:53.744249 20995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "73816f4ab5f84d2b85720a7956f4c199"
format_stamp: "Formatted at 2026-08-12 02:42:53 on dist-test-slave-2p8l"
server_key: "9864c325afa8d7eeba525ee16fb446e4"
server_key_iv: "b212a70148ecdb0e5395b7d4c74f925e"
server_key_version: "encryptionkey@0"
I20260812 02:42:53.744359 20995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:53.761410 20995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:53.764385 20995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:53.764602 20995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:53.765199 20995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:53.766040 20995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:53.766156 20995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:53.766223 20995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:53.766269 20995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:53.776392 20995 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:36081
I20260812 02:42:53.776417 21255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:36081 every 8 connection(s)
I20260812 02:42:53.777341 20995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
Aug 12 02:42:53 dist-test-slave-2p8l krb5kdc[20773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502573, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:53.787557 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 20995
I20260812 02:42:53.787650 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:42:53.788033 10541 external_mini_cluster.cc:1428] Setting key b24ee90f8582fdc4907874cb459e6cce
I20260812 02:42:53.791996 20944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:53.779502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:59223 (local address 127.10.75.126:46239)
0812 02:42:53.779697 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:53.779701 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:53.780525 (+ 824us) server_negotiation.cc:407] Connection header received
0812 02:42:53.781879 (+ 1354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:53.781882 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:53.781930 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:53.782009 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:53.783278 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:53.783815 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:53.784908 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:53.785133 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:53.785221 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:53.787885 (+ 2664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:53.787891 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:53.787894 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:53.787923 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:53.789776 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:53.790394 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:53.790399 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:53.790401 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:53.790489 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:53.790886 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:53.790889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:53.790891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:53.791079 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:53.791190 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:53.791688 (+ 498us) server_negotiation.cc:299] Negotiation successful
0812 02:42:53.791822 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260812 02:42:53.792882 21261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:53.779896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:46239 (local address 127.10.75.65:59223)
0812 02:42:53.780365 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:53.780408 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:53.781663 (+ 1255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:53.782235 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:53.782242 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:53.782636 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:53.783128 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:53.783142 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:53.783927 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:53.783930 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:53.784797 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:53.784806 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:53.785277 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:53.785280 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:53.785413 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:53.786052 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:53.786117 (+ 65us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:53.787629 (+ 1512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:53.789896 (+ 2267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:53.789902 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:53.789920 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:53.790286 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:53.790624 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:53.790627 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:53.790629 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:53.790779 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:53.791190 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:53.791199 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:53.791446 (+ 247us) client_negotiation.cc:769] Sending connection context
0812 02:42:53.791632 (+ 186us) client_negotiation.cc:240] Negotiation successful
0812 02:42:53.791955 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":117,"threads_started":1}
I20260812 02:42:53.794267 21258 heartbeater.cc:347] Connected to a master server at 127.10.75.126:46239
I20260812 02:42:53.794539 21258 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:53.795156 21258 heartbeater.cc:511] Master 127.10.75.126:46239 requested a full tablet report, sending...
I20260812 02:42:53.797194 20863 ts_manager.cc:194] Registered new tserver with Master: 73816f4ab5f84d2b85720a7956f4c199 (127.10.75.65:36081)
I20260812 02:42:53.798942 20863 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:59223
WARNING: no policy specified for kudu/127.10.75.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
I20260812 02:42:53.821244 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:46239
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:53.933763 21267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:53.934059 21267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:53.934162 21267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:53.938275 21267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:53.938360 21267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:53.938454 21267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:42:53.943759 21267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:46239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:53.944866 21267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:53.945923 21267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:53.955709 21275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:53.955740 21278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:53.955937 21267 server_base.cc:1034] running on GCE node
W20260812 02:42:53.955734 21281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:53.956460 21267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:53.957104 21267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:53.958328 21267 hybrid_clock.cc:648] HybridClock initialized: now 1786502573958293 us; error 45 us; skew 500 ppm
Aug 12 02:42:53 dist-test-slave-2p8l krb5kdc[20773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502573, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:53.961202 21267 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:42:53.962240 21267 webserver.cc:460] Webserver started at http://127.10.75.66:33217/ using document root <none> and password file <none>
I20260812 02:42:53.962996 21267 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:53.963107 21267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:53.963397 21267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:53.965941 21267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "e045fcd0a04b46489bd96bdb5eee83d2"
format_stamp: "Formatted at 2026-08-12 02:42:53 on dist-test-slave-2p8l"
server_key: "0312b32203aa2a8739bcf9e2f053f776"
server_key_iv: "f6c10cb832b722cc8a76d189509be0a4"
server_key_version: "encryptionkey@0"
I20260812 02:42:53.966585 21267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "e045fcd0a04b46489bd96bdb5eee83d2"
format_stamp: "Formatted at 2026-08-12 02:42:53 on dist-test-slave-2p8l"
server_key: "0312b32203aa2a8739bcf9e2f053f776"
server_key_iv: "f6c10cb832b722cc8a76d189509be0a4"
server_key_version: "encryptionkey@0"
I20260812 02:42:53.970286 21267 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:42:53.972744 21298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:53.974010 21267 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:42:53.974213 21267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "e045fcd0a04b46489bd96bdb5eee83d2"
format_stamp: "Formatted at 2026-08-12 02:42:53 on dist-test-slave-2p8l"
server_key: "0312b32203aa2a8739bcf9e2f053f776"
server_key_iv: "f6c10cb832b722cc8a76d189509be0a4"
server_key_version: "encryptionkey@0"
I20260812 02:42:53.974334 21267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:53.986992 21267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:53.990275 21267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:53.990473 21267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:53.991060 21267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:53.991915 21267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:53.991990 21267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:53.992058 21267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:53.992110 21267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:54.001617 21267 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:43361
I20260812 02:42:54.001639 21536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:43361 every 8 connection(s)
I20260812 02:42:54.002648 21267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:42:54.008754 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 21267
I20260812 02:42:54.008904 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:42:54.009198 10541 external_mini_cluster.cc:1428] Setting key 29389908298000ad1396d3c8da79dd5c
Aug 12 02:42:54 dist-test-slave-2p8l krb5kdc[20773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502573, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:54.017441 20944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:54.004640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:51765 (local address 127.10.75.126:46239)
0812 02:42:54.004799 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:54.004803 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:54.005673 (+ 870us) server_negotiation.cc:407] Connection header received
0812 02:42:54.007064 (+ 1391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:54.007068 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:54.007129 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:54.007264 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:54.008429 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:54.009071 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:54.010318 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:54.010547 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:54.010659 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:54.013416 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:54.013422 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:54.013426 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:54.013460 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:54.015258 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:54.015788 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:54.015795 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:54.015800 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:54.015914 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:54.016280 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:54.016284 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:54.016286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:54.016554 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:54.016667 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:54.017205 (+ 538us) server_negotiation.cc:299] Negotiation successful
0812 02:42:54.017316 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 02:42:54.018793 21543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:54.005050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:46239 (local address 127.10.75.66:51765)
0812 02:42:54.005517 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:54.005559 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:54.006849 (+ 1290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:54.007437 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:54.007443 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:54.007803 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:54.008281 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:54.008295 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:54.009199 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:54.009205 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:54.010191 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:54.010201 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:54.010721 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:54.010726 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:54.010892 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:54.011535 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:54.011552 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:54.013240 (+ 1688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:54.015382 (+ 2142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:54.015387 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:54.015399 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:54.015678 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:54.016028 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:54.016030 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:54.016031 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:54.016168 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:54.016682 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:54.016687 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:54.016913 (+ 226us) client_negotiation.cc:769] Sending connection context
0812 02:42:54.017156 (+ 243us) client_negotiation.cc:240] Negotiation successful
0812 02:42:54.017552 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":117,"threads_started":1}
I20260812 02:42:54.020181 21538 heartbeater.cc:347] Connected to a master server at 127.10.75.126:46239
I20260812 02:42:54.020457 21538 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.10.75.67@KRBTEST.COM; defaulting to no policy
I20260812 02:42:54.021065 21538 heartbeater.cc:511] Master 127.10.75.126:46239 requested a full tablet report, sending...
I20260812 02:42:54.022217 20863 ts_manager.cc:194] Registered new tserver with Master: e045fcd0a04b46489bd96bdb5eee83d2 (127.10.75.66:43361)
I20260812 02:42:54.022773 20863 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:51765
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
I20260812 02:42:54.041121 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:46239
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:54.152388 21552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:54.152622 21552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:54.152663 21552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:54.156793 21552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:54.156848 21552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:54.156929 21552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:42:54.162243 21552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:46239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:54.163262 21552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:54.164283 21552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:54.173834 21565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:54.173882 21562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:54.173970 21552 server_base.cc:1034] running on GCE node
W20260812 02:42:54.174242 21563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:54.174612 21552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:54.175230 21552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:54.176391 21552 hybrid_clock.cc:648] HybridClock initialized: now 1786502574176364 us; error 39 us; skew 500 ppm
Aug 12 02:42:54 dist-test-slave-2p8l krb5kdc[20773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502574, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:54.179299 21552 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:42:54.180126 21552 webserver.cc:460] Webserver started at http://127.10.75.67:38963/ using document root <none> and password file <none>
I20260812 02:42:54.180629 21552 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:54.180688 21552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:54.180846 21552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:54.182852 21552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "bdb96d41ecc64761ae42980bd690d028"
format_stamp: "Formatted at 2026-08-12 02:42:54 on dist-test-slave-2p8l"
server_key: "cf80a3af5f2fd2d250100d402257af80"
server_key_iv: "7aa46b1f9d8c40443294d99c2015c5f5"
server_key_version: "encryptionkey@0"
I20260812 02:42:54.183368 21552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "bdb96d41ecc64761ae42980bd690d028"
format_stamp: "Formatted at 2026-08-12 02:42:54 on dist-test-slave-2p8l"
server_key: "cf80a3af5f2fd2d250100d402257af80"
server_key_iv: "7aa46b1f9d8c40443294d99c2015c5f5"
server_key_version: "encryptionkey@0"
I20260812 02:42:54.186900 21552 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 02:42:54.189127 21577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:54.190320 21552 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:54.190452 21552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "bdb96d41ecc64761ae42980bd690d028"
format_stamp: "Formatted at 2026-08-12 02:42:54 on dist-test-slave-2p8l"
server_key: "cf80a3af5f2fd2d250100d402257af80"
server_key_iv: "7aa46b1f9d8c40443294d99c2015c5f5"
server_key_version: "encryptionkey@0"
I20260812 02:42:54.190557 21552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:54.209810 21552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:54.213187 21552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:54.213425 21552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:54.214035 21552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:54.214915 21552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:54.214988 21552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:54.215061 21552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:54.215106 21552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:54.224238 21552 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:37525
I20260812 02:42:54.224261 21791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:37525 every 8 connection(s)
I20260812 02:42:54.225142 21552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:42:54.227638 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 21552
I20260812 02:42:54.227768 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:42:54.228076 10541 external_mini_cluster.cc:1428] Setting key e5aa89857505f8f87a3a276a087d85aa
Aug 12 02:42:54 dist-test-slave-2p8l krb5kdc[20773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502574, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:42:54.238756 20944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:54.226979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:58901 (local address 127.10.75.126:46239)
0812 02:42:54.227119 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:54.227123 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:54.228120 (+ 997us) server_negotiation.cc:407] Connection header received
0812 02:42:54.229804 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:54.229807 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:54.229862 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:54.229943 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:54.231167 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:54.231778 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:54.232918 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:54.233146 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:54.233260 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:54.235682 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:54.235685 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:54.235687 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:54.235712 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:54.236944 (+ 1232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:54.237406 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:54.237409 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:54.237410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:54.237488 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:54.237783 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:54.237785 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:54.237786 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:54.237948 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:54.238023 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:54.238532 (+ 509us) server_negotiation.cc:299] Negotiation successful
0812 02:42:54.238631 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 02:42:54.239511 21795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:54.227290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:46239 (local address 127.10.75.67:58901)
0812 02:42:54.227954 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:54.228014 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:54.229579 (+ 1565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:54.230126 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:54.230138 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:54.230576 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:54.231025 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:54.231037 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:54.231907 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:54.231911 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:54.232789 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:54.232798 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:54.233297 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:54.233301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:54.233471 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:54.234020 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:54.234035 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:54.235522 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:54.237049 (+ 1527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:54.237053 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:54.237064 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:54.237318 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:54.237570 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:54.237572 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:54.237573 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:54.237701 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:54.238035 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:54.238040 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:54.238327 (+ 287us) client_negotiation.cc:769] Sending connection context
0812 02:42:54.238480 (+ 153us) client_negotiation.cc:240] Negotiation successful
0812 02:42:54.238714 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":163,"threads_started":1}
I20260812 02:42:54.240546 21792 heartbeater.cc:347] Connected to a master server at 127.10.75.126:46239
I20260812 02:42:54.240788 21792 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:54.241386 21792 heartbeater.cc:511] Master 127.10.75.126:46239 requested a full tablet report, sending...
I20260812 02:42:54.242445 20863 ts_manager.cc:194] Registered new tserver with Master: bdb96d41ecc64761ae42980bd690d028 (127.10.75.67:37525)
I20260812 02:42:54.242996 20863 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:58901
I20260812 02:42:54.253886 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/test-admin.keytab.
Aug 12 02:42:54 dist-test-slave-2p8l krb5kdc[20773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:54.270876 10541 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 02:42:54.273566 21804 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:42:54.272185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57190 (local address 127.10.75.65:36081)
0812 02:42:54.272472 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:54.272487 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:54.272510 (+ 23us) server_negotiation.cc:407] Connection header received
0812 02:42:54.272560 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:54.272565 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:54.272755 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:54.272874 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:54.273382 (+ 508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57190: BlockingRecv error: recv got EOF from 127.0.0.1:57190 (error 108)
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":85,"threads_started":1}
W20260812 02:42:54.273582 10541 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/krb5cc' of type FILE
Aug 12 02:42:54 dist-test-slave-2p8l krb5kdc[20773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:54.274827 10541 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 02:42:54 dist-test-slave-2p8l krb5kdc[20773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:54.275714 10541 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 02:42:54 dist-test-slave-2p8l krb5kdc[20773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.65@KRBTEST.COM
I20260812 02:42:54.286233 21804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:54.276558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57206 (local address 127.10.75.65:36081)
0812 02:42:54.276689 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:54.276694 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:54.276794 (+ 100us) server_negotiation.cc:407] Connection header received
0812 02:42:54.276943 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:54.276946 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:54.276995 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:54.277083 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:54.277688 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:54.278689 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:54.279780 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:54.280170 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:54.280293 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:54.282577 (+ 2284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:54.282587 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:54.282599 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:54.282625 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:54.284125 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:54.284977 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:54.284983 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:54.284984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:54.285074 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:54.285326 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:54.285330 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:54.285331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:54.285570 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:54.285720 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:54.285910 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 02:42:54.286036 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
W20260812 02:42:54.289772 21804 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:42:54.288922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57216 (local address 127.10.75.65:36081)
0812 02:42:54.289059 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:54.289062 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:54.289132 (+ 70us) server_negotiation.cc:407] Connection header received
0812 02:42:54.289214 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:54.289216 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:54.289250 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:54.289313 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:54.289681 (+ 368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57216: BlockingRecv error: recv got EOF from 127.0.0.1:57216 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260812 02:42:54.290185 10541 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/krb5cc)
Aug 12 02:42:54 dist-test-slave-2p8l krb5kdc[20773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:54.291182 10541 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 02:42:54 dist-test-slave-2p8l krb5kdc[20773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:54.292122 10541 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 02:42:54 dist-test-slave-2p8l krb5kdc[20773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.65@KRBTEST.COM
I20260812 02:42:54.300637 21804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:54.292950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57226 (local address 127.10.75.65:36081)
0812 02:42:54.293097 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:54.293102 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:54.293241 (+ 139us) server_negotiation.cc:407] Connection header received
0812 02:42:54.293404 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:54.293407 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:54.293452 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:54.293578 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:54.294123 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:54.294657 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:54.295534 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:54.295762 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:54.295873 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:54.297875 (+ 2002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:54.297878 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:54.297880 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:54.297901 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:54.299119 (+ 1218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:54.299596 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:54.299599 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:54.299600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:54.299675 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:54.299901 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:54.299903 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:54.299904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:54.300054 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:54.300145 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:54.300394 (+ 249us) server_negotiation.cc:299] Negotiation successful
0812 02:42:54.300493 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260812 02:42:54.303567 21804 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:42:54.302522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57242 (local address 127.10.75.65:36081)
0812 02:42:54.302679 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:54.302683 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:54.302802 (+ 119us) server_negotiation.cc:407] Connection header received
0812 02:42:54.302938 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:54.302942 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:54.302987 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:54.303083 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:54.303462 (+ 379us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57242: BlockingRecv error: recv got EOF from 127.0.0.1:57242 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260812 02:42:54.303809 10541 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786502539688512-10541-0/krb5kdc/krb5cc' of type FILE
Aug 12 02:42:54 dist-test-slave-2p8l krb5kdc[20773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:54.304747 10541 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 02:42:54 dist-test-slave-2p8l krb5kdc[20773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:54.305584 10541 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 02:42:54 dist-test-slave-2p8l krb5kdc[20773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.65@KRBTEST.COM
I20260812 02:42:54.313388 21804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:54.306385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57246 (local address 127.10.75.65:36081)
0812 02:42:54.306505 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:54.306509 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:54.306648 (+ 139us) server_negotiation.cc:407] Connection header received
0812 02:42:54.306744 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:54.306747 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:54.306788 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:54.306852 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:54.307287 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:54.307754 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:54.308458 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:54.308673 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:54.308751 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:54.310811 (+ 2060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:54.310814 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:54.310815 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:54.310836 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:54.312002 (+ 1166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:54.312390 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:54.312393 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:54.312394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:54.312462 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:54.312695 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:54.312697 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:54.312698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:54.312839 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:54.312931 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:54.313119 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 02:42:54.313234 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 02:42:54.314404 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 20995
I20260812 02:42:54.332252 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 21267
I20260812 02:42:54.342036 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 21552
I20260812 02:42:54.358311 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 20801
2026-08-12T02:42:54Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2510 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:42:54 dist-test-slave-2p8l krb5kdc[21829](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:42:54 dist-test-slave-2p8l krb5kdc[21829](info): set up 2 sockets
Aug 12 02:42:54 dist-test-slave-2p8l krb5kdc[21829](info): commencing operation
krb5kdc: starting...
W20260812 02:42:55.666448 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:42:55 dist-test-slave-2p8l krb5kdc[21829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:42:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:42:55Z Disabled control of system clock
WARNING: no policy specified for oryx/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.126.keytab.
Entry for principal oryx/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.126.keytab.
I20260812 02:42:55.792965 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:34761
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.126.keytab
--principal=oryx/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:46185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:34761
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:55.904784 21847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:55.905089 21847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:55.905164 21847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:55.909127 21847 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:42:55.909220 21847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:55.909260 21847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:55.909318 21847 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:42:55.909359 21847 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:42:55.914467 21847 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:46185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:34761
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.126.keytab
--principal=oryx/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:34761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:55.915467 21847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:55.916468 21847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:55.924935 21856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:55.924932 21855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:55.924963 21859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:55.925208 21847 server_base.cc:1034] running on GCE node
I20260812 02:42:55.925830 21847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:55.926981 21847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:55.928184 21847 hybrid_clock.cc:648] HybridClock initialized: now 1786502575928165 us; error 39 us; skew 500 ppm
Aug 12 02:42:55 dist-test-slave-2p8l krb5kdc[21829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502575, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:55.931002 21847 init.cc:377] Logged in from keytab as oryx/127.10.75.126@KRBTEST.COM (short username oryx)
I20260812 02:42:55.931862 21847 webserver.cc:460] Webserver started at http://127.10.75.126:44263/ using document root <none> and password file <none>
I20260812 02:42:55.932425 21847 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:55.932521 21847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:55.932744 21847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:55.934813 21847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "c62d7bb434ff489f9f7fa8e977d85c14"
format_stamp: "Formatted at 2026-08-12 02:42:55 on dist-test-slave-2p8l"
server_key: "f5e713696c9477ccf6f04f2287544c3e"
server_key_iv: "081694da51767265c5ab77d9e2e24a83"
server_key_version: "encryptionkey@0"
I20260812 02:42:55.935376 21847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "c62d7bb434ff489f9f7fa8e977d85c14"
format_stamp: "Formatted at 2026-08-12 02:42:55 on dist-test-slave-2p8l"
server_key: "f5e713696c9477ccf6f04f2287544c3e"
server_key_iv: "081694da51767265c5ab77d9e2e24a83"
server_key_version: "encryptionkey@0"
I20260812 02:42:55.939013 21847 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 02:42:55.941303 21878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:55.942535 21847 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:55.942687 21847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "c62d7bb434ff489f9f7fa8e977d85c14"
format_stamp: "Formatted at 2026-08-12 02:42:55 on dist-test-slave-2p8l"
server_key: "f5e713696c9477ccf6f04f2287544c3e"
server_key_iv: "081694da51767265c5ab77d9e2e24a83"
server_key_version: "encryptionkey@0"
I20260812 02:42:55.942811 21847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:55.995805 21847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:55.999013 21847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:55.999238 21847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:56.006582 21847 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:34761
I20260812 02:42:56.006882 21965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:34761 every 8 connection(s)
I20260812 02:42:56.007615 21847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:42:56.009326 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 21847
I20260812 02:42:56.009471 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:42:56.009759 10541 external_mini_cluster.cc:1428] Setting key dfcd394346be5de6dcda6508ad7e6614
I20260812 02:42:56.010739 21966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:56.017539 21966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14: Bootstrap starting.
Aug 12 02:42:56 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM
I20260812 02:42:56.019811 21966 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:56.020787 21966 log.cc:824] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:56.023132 21966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14: No bootstrap required, opened a new log
I20260812 02:42:56.025117 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:56.011234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45784 (local address 127.10.75.126:34761)
0812 02:42:56.011677 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:56.011698 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:56.011742 (+ 44us) server_negotiation.cc:407] Connection header received
0812 02:42:56.012604 (+ 862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:56.012631 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:56.013041 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:56.013414 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:56.014142 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.015623 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.016475 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.017210 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.017369 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:56.020013 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:56.020033 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:56.020052 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:56.020091 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:56.022030 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:56.022466 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:56.022472 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:56.022477 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:56.022617 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:56.022899 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:56.022902 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:56.022904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:56.023409 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:56.023596 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:56.023861 (+ 265us) server_negotiation.cc:299] Negotiation successful
0812 02:42:56.024167 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":120,"threads_started":1}
I20260812 02:42:56.027460 21966 raft_consensus.cc:348] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } }
I20260812 02:42:56.027702 21966 raft_consensus.cc:374] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:56.027740 21966 raft_consensus.cc:729] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c62d7bb434ff489f9f7fa8e977d85c14, State: Initialized, Role: FOLLOWER
I20260812 02:42:56.028096 21966 consensus_queue.cc:260] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } }
I20260812 02:42:56.028214 21966 raft_consensus.cc:388] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:42:56.028254 21966 raft_consensus.cc:482] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:42:56.028321 21966 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:56.029595 21966 raft_consensus.cc:504] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } }
I20260812 02:42:56.029906 21966 leader_election.cc:302] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c62d7bb434ff489f9f7fa8e977d85c14; no voters:
I20260812 02:42:56.030244 21966 leader_election.cc:288] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:42:56.030376 21984 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:56.030668 21984 raft_consensus.cc:686] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [term 1 LEADER]: Becoming Leader. State: Replica: c62d7bb434ff489f9f7fa8e977d85c14, State: Running, Role: LEADER
I20260812 02:42:56.031023 21984 consensus_queue.cc:237] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } }
I20260812 02:42:56.031641 21966 sys_catalog.cc:564] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:42:56.032793 21985 sys_catalog.cc:455] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } }
I20260812 02:42:56.032842 21986 sys_catalog.cc:455] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c62d7bb434ff489f9f7fa8e977d85c14. Latest consensus state: current_term: 1 leader_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } }
I20260812 02:42:56.032982 21985 sys_catalog.cc:458] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:56.033021 21986 sys_catalog.cc:458] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:56.033360 21999 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:42:56.036635 21999 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:42:56.043152 21999 catalog_manager.cc:1347] Generated new cluster ID: aa7a20c8e90a4c46a42e4879721e8d83
I20260812 02:42:56.043273 21999 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:42:56.056037 21999 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:42:56.057029 21999 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:42:56.061685 21999 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14: Generated new TSK 0
I20260812 02:42:56.062328 21999 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.65.keytab.
Entry for principal oryx/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.65.keytab.
I20260812 02:42:56.098270 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:34761
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.65.keytab
--principal=oryx/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:46185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:56.209813 22023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:56.210052 22023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:56.210109 22023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:56.214004 22023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:56.214052 22023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:56.214123 22023 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:42:56.219169 22023 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:46185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.65.keytab
--principal=oryx/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:34761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22023
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:56.220140 22023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:56.221089 22023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:56.230626 22028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:56.230616 22030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:56.230718 22032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:56.230948 22023 server_base.cc:1034] running on GCE node
I20260812 02:42:56.231398 22023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:56.232090 22023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:56.233327 22023 hybrid_clock.cc:648] HybridClock initialized: now 1786502576233300 us; error 42 us; skew 500 ppm
Aug 12 02:42:56 dist-test-slave-2p8l krb5kdc[21829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502576, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:56.236348 22023 init.cc:377] Logged in from keytab as oryx/127.10.75.65@KRBTEST.COM (short username oryx)
I20260812 02:42:56.237226 22023 webserver.cc:460] Webserver started at http://127.10.75.65:41335/ using document root <none> and password file <none>
I20260812 02:42:56.237825 22023 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:56.237929 22023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:56.238294 22023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:56.240808 22023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "edcbf2fd16e943468048d0905f706883"
format_stamp: "Formatted at 2026-08-12 02:42:56 on dist-test-slave-2p8l"
server_key: "791205df7e5ec8f3bbe13b1c1171c595"
server_key_iv: "a41ba1d84ce2531471e7e24e2d34662c"
server_key_version: "encryptionkey@0"
I20260812 02:42:56.241407 22023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "edcbf2fd16e943468048d0905f706883"
format_stamp: "Formatted at 2026-08-12 02:42:56 on dist-test-slave-2p8l"
server_key: "791205df7e5ec8f3bbe13b1c1171c595"
server_key_iv: "a41ba1d84ce2531471e7e24e2d34662c"
server_key_version: "encryptionkey@0"
I20260812 02:42:56.245151 22023 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260812 02:42:56.247782 22048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:56.249033 22023 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:42:56.249192 22023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "edcbf2fd16e943468048d0905f706883"
format_stamp: "Formatted at 2026-08-12 02:42:56 on dist-test-slave-2p8l"
server_key: "791205df7e5ec8f3bbe13b1c1171c595"
server_key_iv: "a41ba1d84ce2531471e7e24e2d34662c"
server_key_version: "encryptionkey@0"
I20260812 02:42:56.249312 22023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:56.276145 22023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:56.279088 22023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:56.279299 22023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:56.279898 22023 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:56.280725 22023 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:56.280805 22023 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:56.280875 22023 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:56.280944 22023 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:56.290447 22023 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:46729
I20260812 02:42:56.290475 22259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:46729 every 8 connection(s)
I20260812 02:42:56.291297 22023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:42:56.295171 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 22023
I20260812 02:42:56.295282 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:42:56.295614 10541 external_mini_cluster.cc:1428] Setting key 53382ff55474e2d991cb11363b5befbf
Aug 12 02:42:56 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502576, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM
I20260812 02:42:56.306380 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:56.293169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:34089 (local address 127.10.75.126:34761)
0812 02:42:56.293324 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:56.293329 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:56.294221 (+ 892us) server_negotiation.cc:407] Connection header received
0812 02:42:56.295620 (+ 1399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:56.295623 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:56.295679 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:56.295787 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:56.297229 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.297762 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.299066 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.299315 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.299400 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:56.302227 (+ 2827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:56.302234 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:56.302241 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:56.302276 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:56.304120 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:56.304682 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:56.304688 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:56.304691 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:56.304795 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:56.305136 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:56.305141 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:56.305145 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:56.305409 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:56.305539 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:56.306019 (+ 480us) server_negotiation.cc:299] Negotiation successful
0812 02:42:56.306178 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
WARNING: no policy specified for oryx/127.10.75.66@KRBTEST.COM; defaulting to no policy
I20260812 02:42:56.307094 22269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:56.293576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.65:34089)
0812 02:42:56.294025 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:56.294066 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:56.295370 (+ 1304us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:56.295980 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:56.295988 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:56.296465 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:56.297074 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:56.297093 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.297901 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.297904 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:56.298906 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:56.298921 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.299476 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.299482 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:56.299701 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:56.300298 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:56.300323 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:56.302008 (+ 1685us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:56.304252 (+ 2244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:56.304256 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:56.304267 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:56.304551 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:56.304890 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:56.304893 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:56.304894 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:56.305019 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:56.305543 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:56.305548 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:56.305758 (+ 210us) client_negotiation.cc:769] Sending connection context
0812 02:42:56.305900 (+ 142us) client_negotiation.cc:240] Negotiation successful
0812 02:42:56.306204 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":118,"threads_started":1}
I20260812 02:42:56.308296 22260 heartbeater.cc:347] Connected to a master server at 127.10.75.126:34761
I20260812 02:42:56.308527 22260 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:56.308998 22260 heartbeater.cc:511] Master 127.10.75.126:34761 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.75.66@KRBTEST.COM" created.
I20260812 02:42:56.310570 21912 ts_manager.cc:194] Registered new tserver with Master: edcbf2fd16e943468048d0905f706883 (127.10.75.65:46729)
I20260812 02:42:56.311690 21912 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:34089
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.66.keytab.
Entry for principal oryx/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.66.keytab.
I20260812 02:42:56.330615 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:34761
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.66.keytab
--principal=oryx/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:46185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:56.442355 22276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:56.442570 22276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:56.442654 22276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:56.446709 22276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:56.446758 22276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:56.446854 22276 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:42:56.451869 22276 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:46185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.66.keytab
--principal=oryx/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:34761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:56.452800 22276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:56.453747 22276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:56.463444 22287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:56.463464 22285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:56.463550 22276 server_base.cc:1034] running on GCE node
W20260812 02:42:56.463464 22289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:56.464077 22276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:56.464694 22276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:56.465862 22276 hybrid_clock.cc:648] HybridClock initialized: now 1786502576465847 us; error 26 us; skew 500 ppm
Aug 12 02:42:56 dist-test-slave-2p8l krb5kdc[21829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502576, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:56.468843 22276 init.cc:377] Logged in from keytab as oryx/127.10.75.66@KRBTEST.COM (short username oryx)
I20260812 02:42:56.469686 22276 webserver.cc:460] Webserver started at http://127.10.75.66:38423/ using document root <none> and password file <none>
I20260812 02:42:56.470281 22276 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:56.470371 22276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:56.470619 22276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:56.472575 22276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "20594d0fcd92491f82ad39004fd7894f"
format_stamp: "Formatted at 2026-08-12 02:42:56 on dist-test-slave-2p8l"
server_key: "a5ce5f55fac6cb82df52c7db198c9e6f"
server_key_iv: "28ac1b2dc86e3fb306f45066cfca8acf"
server_key_version: "encryptionkey@0"
I20260812 02:42:56.473145 22276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "20594d0fcd92491f82ad39004fd7894f"
format_stamp: "Formatted at 2026-08-12 02:42:56 on dist-test-slave-2p8l"
server_key: "a5ce5f55fac6cb82df52c7db198c9e6f"
server_key_iv: "28ac1b2dc86e3fb306f45066cfca8acf"
server_key_version: "encryptionkey@0"
I20260812 02:42:56.476840 22276 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260812 02:42:56.479259 22304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:56.480445 22276 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:42:56.480618 22276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "20594d0fcd92491f82ad39004fd7894f"
format_stamp: "Formatted at 2026-08-12 02:42:56 on dist-test-slave-2p8l"
server_key: "a5ce5f55fac6cb82df52c7db198c9e6f"
server_key_iv: "28ac1b2dc86e3fb306f45066cfca8acf"
server_key_version: "encryptionkey@0"
I20260812 02:42:56.480736 22276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:56.495666 22276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:56.498667 22276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:56.498880 22276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:56.499496 22276 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:56.500344 22276 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:56.500391 22276 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:56.500459 22276 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:56.500494 22276 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:56.509130 22276 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:43595
I20260812 02:42:56.509195 22527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:43595 every 8 connection(s)
I20260812 02:42:56.510100 22276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:42:56.517506 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 22276
I20260812 02:42:56.517678 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:42:56.517995 10541 external_mini_cluster.cc:1428] Setting key 8fe4757fd0ece1a8f578edf133a6b445
Aug 12 02:42:56 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502576, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM
I20260812 02:42:56.524688 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:56.511951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:59883 (local address 127.10.75.126:34761)
0812 02:42:56.512116 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:56.512120 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:56.513120 (+ 1000us) server_negotiation.cc:407] Connection header received
0812 02:42:56.514506 (+ 1386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:56.514509 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:56.514558 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:56.514638 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:56.515771 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.516312 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.517539 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.517878 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.517966 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:56.520605 (+ 2639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:56.520609 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:56.520612 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:56.520642 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:56.522414 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:56.522905 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:56.522910 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:56.522912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:56.523016 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:56.523368 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:56.523374 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:56.523378 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:56.523644 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:56.523755 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:56.524267 (+ 512us) server_negotiation.cc:299] Negotiation successful
0812 02:42:56.524407 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 02:42:56.525430 22533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:56.512319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.66:59883)
0812 02:42:56.512938 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:56.512980 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:56.514285 (+ 1305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:56.514801 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:56.514808 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:56.515162 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:56.515612 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:56.515629 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.516433 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.516436 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:56.517399 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:56.517412 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.518043 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.518048 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:56.518277 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:56.518936 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:56.518952 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:56.520432 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:56.522532 (+ 2100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:56.522537 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:56.522548 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:56.522798 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:56.523132 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:56.523134 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:56.523135 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:56.523261 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:56.523755 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:56.523760 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:56.523966 (+ 206us) client_negotiation.cc:769] Sending connection context
0812 02:42:56.524194 (+ 228us) client_negotiation.cc:240] Negotiation successful
0812 02:42:56.524546 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":290,"threads_started":1}
I20260812 02:42:56.526671 22528 heartbeater.cc:347] Connected to a master server at 127.10.75.126:34761
I20260812 02:42:56.526901 22528 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:56.527390 22528 heartbeater.cc:511] Master 127.10.75.126:34761 requested a full tablet report, sending...
I20260812 02:42:56.528434 21912 ts_manager.cc:194] Registered new tserver with Master: 20594d0fcd92491f82ad39004fd7894f (127.10.75.66:43595)
I20260812 02:42:56.529002 21912 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:59883
WARNING: no policy specified for oryx/127.10.75.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.75.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.67.keytab.
Entry for principal oryx/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.67.keytab.
I20260812 02:42:56.550279 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:34761
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.67.keytab
--principal=oryx/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:46185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:56.662554 22536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:56.662786 22536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:56.662825 22536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:56.666831 22536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:56.666882 22536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:56.666936 22536 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:42:56.672014 22536 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:46185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.67.keytab
--principal=oryx/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:34761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:56.672959 22536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:56.673926 22536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:56.683210 22549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:56.683180 22542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:56.683183 22543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:56.683254 22536 server_base.cc:1034] running on GCE node
I20260812 02:42:56.683912 22536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:56.684548 22536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:56.685750 22536 hybrid_clock.cc:648] HybridClock initialized: now 1786502576685729 us; error 31 us; skew 500 ppm
Aug 12 02:42:56 dist-test-slave-2p8l krb5kdc[21829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502576, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:56.688459 22536 init.cc:377] Logged in from keytab as oryx/127.10.75.67@KRBTEST.COM (short username oryx)
I20260812 02:42:56.689407 22536 webserver.cc:460] Webserver started at http://127.10.75.67:33647/ using document root <none> and password file <none>
I20260812 02:42:56.689946 22536 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:56.690040 22536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:56.690258 22536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:56.692185 22536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "9f5c8fc0597e46b4843cefda11b516bd"
format_stamp: "Formatted at 2026-08-12 02:42:56 on dist-test-slave-2p8l"
server_key: "10d2945d3291b7a209ac54b907172f55"
server_key_iv: "a721462adcee6b99f5ea3b0dea6f2cb7"
server_key_version: "encryptionkey@0"
I20260812 02:42:56.692817 22536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "9f5c8fc0597e46b4843cefda11b516bd"
format_stamp: "Formatted at 2026-08-12 02:42:56 on dist-test-slave-2p8l"
server_key: "10d2945d3291b7a209ac54b907172f55"
server_key_iv: "a721462adcee6b99f5ea3b0dea6f2cb7"
server_key_version: "encryptionkey@0"
I20260812 02:42:56.696480 22536 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 02:42:56.698881 22558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:56.700083 22536 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:56.700238 22536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "9f5c8fc0597e46b4843cefda11b516bd"
format_stamp: "Formatted at 2026-08-12 02:42:56 on dist-test-slave-2p8l"
server_key: "10d2945d3291b7a209ac54b907172f55"
server_key_iv: "a721462adcee6b99f5ea3b0dea6f2cb7"
server_key_version: "encryptionkey@0"
I20260812 02:42:56.700348 22536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:56.709326 22536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:56.712302 22536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:56.712505 22536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:56.713084 22536 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:56.713873 22536 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:56.713948 22536 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:56.714016 22536 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:56.714085 22536 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:56.723315 22536 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:42971
I20260812 02:42:56.723341 22804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:42971 every 8 connection(s)
I20260812 02:42:56.724149 22536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:42:56.727118 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 22536
I20260812 02:42:56.727236 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:42:56.727643 10541 external_mini_cluster.cc:1428] Setting key 3af8be7718bb9d8823867e932d3d057f
Aug 12 02:42:56 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502576, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM
I20260812 02:42:56.737816 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:56.725893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:39845 (local address 127.10.75.126:34761)
0812 02:42:56.726088 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:56.726093 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:56.726862 (+ 769us) server_negotiation.cc:407] Connection header received
0812 02:42:56.728537 (+ 1675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:56.728541 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:56.728603 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:56.728689 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:56.730202 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.730725 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.731839 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.732057 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.732132 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:56.734728 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:56.734731 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:56.734733 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:56.734755 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:56.736011 (+ 1256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:56.736493 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:56.736496 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:56.736497 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:56.736572 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:56.736887 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:56.736890 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:56.736891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:56.737060 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:56.737149 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:56.737590 (+ 441us) server_negotiation.cc:299] Negotiation successful
0812 02:42:56.737698 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 02:42:56.738595 22810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:56.726268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.67:39845)
0812 02:42:56.726704 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:56.726746 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:56.728286 (+ 1540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:56.728867 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:56.728874 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:56.729393 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:56.730027 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:56.730046 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.730838 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.730841 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:56.731727 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:56.731736 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.732184 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.732186 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:56.732386 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:56.733057 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:56.733073 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:56.734567 (+ 1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:56.736117 (+ 1550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:56.736122 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:56.736133 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:56.736393 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:56.736654 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:56.736657 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:56.736658 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:56.736787 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:56.737167 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:56.737172 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:56.737380 (+ 208us) client_negotiation.cc:769] Sending connection context
0812 02:42:56.737523 (+ 143us) client_negotiation.cc:240] Negotiation successful
0812 02:42:56.737764 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":110,"threads_started":1}
I20260812 02:42:56.739689 22807 heartbeater.cc:347] Connected to a master server at 127.10.75.126:34761
I20260812 02:42:56.739924 22807 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:56.740473 22807 heartbeater.cc:511] Master 127.10.75.126:34761 requested a full tablet report, sending...
I20260812 02:42:56.741521 21912 ts_manager.cc:194] Registered new tserver with Master: 9f5c8fc0597e46b4843cefda11b516bd (127.10.75.67:42971)
I20260812 02:42:56.742211 21912 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:39845
I20260812 02:42:56.753319 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.10.75.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.75.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.75.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.125.keytab.
Entry for principal oryx/127.10.75.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.125.keytab.
I20260812 02:42:56.781843 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.125:46667
--webserver_interface=127.10.75.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.125.keytab
--principal=oryx/127.10.75.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:46185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:34761,127.10.75.125:46667
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:42:56.901608 22813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:56.901873 22813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:56.901929 22813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:56.906129 22813 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:42:56.906186 22813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:56.906208 22813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:56.906252 22813 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:42:56.906284 22813 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:42:56.911415 22813 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:46185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:34761,127.10.75.125:46667
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.125.keytab
--principal=oryx/127.10.75.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.125:46667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.75.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
W20260812 02:42:56.911585 22813 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.10.75.126:34761,127.10.75.125:46667'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 02:42:56.912443 22813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:56.913450 22813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:56.921712 22824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:56.921746 22830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:56.921864 22813 server_base.cc:1034] running on GCE node
W20260812 02:42:56.921720 22827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:56.922554 22813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:56.923689 22813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:56.924868 22813 hybrid_clock.cc:648] HybridClock initialized: now 1786502576924842 us; error 44 us; skew 500 ppm
Aug 12 02:42:56 dist-test-slave-2p8l krb5kdc[21829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502576, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:56.927630 22813 init.cc:377] Logged in from keytab as oryx/127.10.75.125@KRBTEST.COM (short username oryx)
I20260812 02:42:56.928550 22813 webserver.cc:460] Webserver started at http://127.10.75.125:34965/ using document root <none> and password file <none>
I20260812 02:42:56.929095 22813 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:56.929157 22813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:56.929369 22813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:56.931406 22813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/data/instance:
uuid: "9be2ee0c5ec74360804306d6aad865cd"
format_stamp: "Formatted at 2026-08-12 02:42:56 on dist-test-slave-2p8l"
server_key: "e384990491706d071b270d80ffd08ee1"
server_key_iv: "4638fb2ed7c66a49b973be0d8f9bb284"
server_key_version: "encryptionkey@0"
I20260812 02:42:56.932015 22813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/wal/instance:
uuid: "9be2ee0c5ec74360804306d6aad865cd"
format_stamp: "Formatted at 2026-08-12 02:42:56 on dist-test-slave-2p8l"
server_key: "e384990491706d071b270d80ffd08ee1"
server_key_iv: "4638fb2ed7c66a49b973be0d8f9bb284"
server_key_version: "encryptionkey@0"
I20260812 02:42:56.935993 22813 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 02:42:56.938385 22844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:56.939574 22813 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:42:56.939731 22813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/wal
uuid: "9be2ee0c5ec74360804306d6aad865cd"
format_stamp: "Formatted at 2026-08-12 02:42:56 on dist-test-slave-2p8l"
server_key: "e384990491706d071b270d80ffd08ee1"
server_key_iv: "4638fb2ed7c66a49b973be0d8f9bb284"
server_key_version: "encryptionkey@0"
I20260812 02:42:56.939843 22813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:56.964423 22813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:56.967635 22813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:56.967854 22813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:56.975587 22813 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.125:46667
I20260812 02:42:56.975929 22953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.125:46667 every 8 connection(s)
I20260812 02:42:56.976868 22813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/data/info.pb
I20260812 02:42:56.979035 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 22813
I20260812 02:42:56.980233 22954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:56.984783 22954 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 02:42:56 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.75.125@KRBTEST.COM
Aug 12 02:42:56 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502576, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.125@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM
I20260812 02:42:56.994346 22960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:56.980728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44034 (local address 127.10.75.125:46667)
0812 02:42:56.981176 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:56.981194 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:56.981228 (+ 34us) server_negotiation.cc:407] Connection header received
0812 02:42:56.981858 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:56.981874 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:56.982262 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:56.982587 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:56.983405 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.984419 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.985365 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.985830 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.986007 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:56.989129 (+ 3122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:56.989134 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:56.989143 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:56.989169 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:56.991184 (+ 2015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:56.991663 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:56.991668 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:56.991672 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:56.991771 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:56.992075 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:56.992078 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:56.992079 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:56.992516 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:56.992757 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:56.992986 (+ 229us) server_negotiation.cc:299] Negotiation successful
0812 02:42:56.993275 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":158,"threads_started":1}
I20260812 02:42:56.996129 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:56.986787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59652 (local address 127.10.75.126:34761)
0812 02:42:56.986949 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:56.986953 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:56.987130 (+ 177us) server_negotiation.cc:407] Connection header received
0812 02:42:56.987280 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:56.987285 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:56.987355 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:56.987457 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:56.988108 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.988704 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.989891 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.990230 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.990353 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:56.992632 (+ 2279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:56.992636 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:56.992658 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:56.992685 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:56.994321 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:56.994831 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:56.994834 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:56.994836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:56.994927 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:56.995186 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:56.995190 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:56.995191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:56.995482 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:56.995590 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:56.995925 (+ 335us) server_negotiation.cc:299] Negotiation successful
0812 02:42:56.996021 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 02:42:56.996235 22963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:56.986633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.0.0.1:59652)
0812 02:42:56.986988 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:56.987035 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:56.987155 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:56.987498 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:56.987502 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:56.987816 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:56.987938 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:56.987972 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.988859 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.988863 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:56.989746 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:56.989764 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.990356 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.990360 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:56.990484 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:56.990982 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:56.990995 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:56.992488 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:56.994453 (+ 1965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:56.994464 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:56.994472 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:56.994726 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:56.995021 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:56.995023 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:56.995025 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:56.995098 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:56.995605 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:56.995611 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:56.995721 (+ 110us) client_negotiation.cc:769] Sending connection context
0812 02:42:56.995870 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 02:42:56.996036 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":133,"threads_started":1}
I20260812 02:42:56.997427 22954 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 02:42:56 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502576, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.125@KRBTEST.COM for oryx/127.10.75.125@KRBTEST.COM
I20260812 02:42:57.005059 22963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:56.997921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:46667 (local address 127.0.0.1:44038)
0812 02:42:56.998042 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:56.998056 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:56.998166 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:56.998397 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:56.998400 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:56.998555 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:56.998631 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:56.998636 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.999682 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:56.999685 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.000181 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.000188 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.000634 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.000638 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.000722 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.001086 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:57.001097 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:57.002274 (+ 1177us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:57.003781 (+ 1507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.003783 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.003785 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.003966 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.004209 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.004211 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.004212 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.004282 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.004710 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:57.004712 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:57.004784 (+ 72us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.004868 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.004956 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 02:42:57.005177 22960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:56.997968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44038 (local address 127.10.75.125:46667)
0812 02:42:56.998093 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:56.998099 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:56.998113 (+ 14us) server_negotiation.cc:407] Connection header received
0812 02:42:56.998264 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:56.998267 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:56.998302 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:56.998387 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:56.998744 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:56.999552 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.000295 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.000530 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.000646 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.002393 (+ 1747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.002396 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.002398 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.002418 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.003688 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.004047 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.004049 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.004051 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.004117 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.004378 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.004382 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.004385 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.004613 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.004705 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.004926 (+ 221us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.005011 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 02:42:57.007683 22954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: Bootstrap starting.
I20260812 02:42:57.009830 22954 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:57.010605 22954 log.cc:824] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:57.012352 22954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: No bootstrap required, opened a new log
I20260812 02:42:57.015254 22954 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } }
I20260812 02:42:57.015473 22954 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:57.015558 22954 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9be2ee0c5ec74360804306d6aad865cd, State: Initialized, Role: FOLLOWER
I20260812 02:42:57.015970 22954 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } }
I20260812 02:42:57.016438 22969 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } } }
I20260812 02:42:57.016562 22969 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:42:57.017158 22954 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [sys.catalog]: configured and running, proceeding with master startup.
W20260812 02:42:57.022264 22992 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:42:57.022363 22992 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:42:57.024847 22813 master_runner.cc:428] Detected that this master 9be2ee0c5ec74360804306d6aad865cd is joining an existing cluster
I20260812 02:42:57.024909 22813 master_runner.cc:432] Initiating AddMaster RPC to add 127.10.75.125:46667
I20260812 02:42:57.036228 23002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.027082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:46667 (local address 127.0.0.1:44046)
0812 02:42:57.027481 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.027495 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.027579 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.028067 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.028070 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.028309 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:57.028437 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.028445 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.029539 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.029542 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.030293 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.030303 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.030939 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.030945 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.031063 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.031670 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:57.031686 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:57.032195 (+ 509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:57.034415 (+ 2220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.034422 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.034424 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.034700 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.035003 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.035006 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.035008 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.035079 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.035544 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:57.035547 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:57.035655 (+ 108us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.035808 (+ 153us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.035964 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"mutex_wait_us":1,"thread_start_us":106,"threads_started":1}
I20260812 02:42:57.036309 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.027059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59666 (local address 127.10.75.126:34761)
0812 02:42:57.027180 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.027185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.027417 (+ 232us) server_negotiation.cc:407] Connection header received
0812 02:42:57.027609 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.027613 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.027664 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.027717 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:57.028314 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.029205 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.030495 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.030877 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.030974 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.032505 (+ 1531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.032509 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.032512 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.032539 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.034495 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.034993 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.034997 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.034999 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.035097 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.035433 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.035436 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.035438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.035651 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.035757 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.036028 (+ 271us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.036148 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 02:42:57.036360 22998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.027008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.0.0.1:59666)
0812 02:42:57.027330 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.027344 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.027490 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.027880 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.027882 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.028073 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:57.028185 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.028191 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.029339 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.029343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.030385 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.030396 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.031101 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.031103 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.031206 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.031870 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:57.031883 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:57.032380 (+ 497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:57.034607 (+ 2227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.034611 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.034614 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.034861 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.035235 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.035242 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.035245 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.035323 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.035768 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:57.035774 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:57.035865 (+ 91us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.035978 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.036107 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"mutex_wait_us":53,"thread_start_us":96,"threads_started":1}
I20260812 02:42:57.037048 22960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.027446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44046 (local address 127.10.75.125:46667)
0812 02:42:57.027570 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.027576 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.027590 (+ 14us) server_negotiation.cc:407] Connection header received
0812 02:42:57.027663 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.027666 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.027708 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.027783 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:57.028567 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.029403 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.030420 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.030782 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.030891 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.032384 (+ 1493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.032388 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.032391 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.032417 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.034298 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.034812 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.034816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.034818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.034906 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.035184 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.035189 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.035191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.035434 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.035542 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.035872 (+ 330us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.036905 (+ 1033us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":901,"server-negotiator.queue_time_us":42}
Aug 12 02:42:57 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502575, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.126@KRBTEST.COM for oryx/127.10.75.125@KRBTEST.COM
I20260812 02:42:57.051029 22960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.041132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44056 (local address 127.10.75.125:46667)
0812 02:42:57.041282 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.041288 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.041680 (+ 392us) server_negotiation.cc:407] Connection header received
0812 02:42:57.041863 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.041865 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.041910 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.041981 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:57.042767 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.043415 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.044670 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.044895 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.044981 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.047602 (+ 2621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.047606 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.047608 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.047629 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.049157 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.049679 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.049684 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.049686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.049766 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.050092 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.050097 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.050099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.050289 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.050406 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.050756 (+ 350us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.050869 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 02:42:57.051045 23004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.041129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:46667 (local address 127.0.0.1:44056)
0812 02:42:57.041527 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.041586 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.041726 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.042040 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.042047 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.042516 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:57.042641 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.042650 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.043521 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.043524 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.044523 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.044535 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.045009 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.045013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.045123 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.045667 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:57.045682 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:57.047445 (+ 1763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:57.049286 (+ 1841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.049298 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.049304 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.049565 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.049868 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.049871 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.049873 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.049966 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.050409 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:57.050418 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:57.050546 (+ 128us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.050700 (+ 154us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.050887 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":106,"threads_started":1}
I20260812 02:42:57.056106 21912 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.10.75.125:46667: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd"
member_type: NON_VOTER
last_known_addr {
host: "127.10.75.125"
port: 46667
}
attrs {
promote: true
}
}
dest_uuid: "c62d7bb434ff489f9f7fa8e977d85c14"
cas_config_opid_index: -1
I20260812 02:42:57.056994 21912 consensus_queue.cc:237] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: NON_VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: true } }
I20260812 02:42:57.058904 23008 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 9be2ee0c5ec74360804306d6aad865cd (127.10.75.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: NON_VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: true } } }
I20260812 02:42:57.059542 22904 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:57.060904 23008 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.10.75.125:46667
I20260812 02:42:57.061336 22904 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 1 FOLLOWER]: Refusing update from remote peer c62d7bb434ff489f9f7fa8e977d85c14: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 02:42:57.061427 22813 master.cc:537] Master@127.10.75.125:46667 shutting down...
I20260812 02:42:57.062192 23008 sys_catalog.cc:455] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: NON_VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: true } } }
I20260812 02:42:57.062383 23008 sys_catalog.cc:458] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:57.062965 23008 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: NON_VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
WARNING: no policy specified for oryx/127.10.75.124@KRBTEST.COM; defaulting to no policy
I20260812 02:42:57.066850 22813 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:42:57.067137 22813 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:57.067266 22813 tablet_replica.cc:330] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: stopping tablet replica
W20260812 02:42:57.068198 21885 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.75.124@KRBTEST.COM" created.
I20260812 02:42:57.072095 23004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.071739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:46667 (local address 127.0.0.1:44066)
0812 02:42:57.071884 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.071969 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.125:46667: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 02:42:57.072279 21885 consensus_peers.cc:487] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 -> Peer 9be2ee0c5ec74360804306d6aad865cd (127.10.75.125:46667): Couldn't send request to peer 9be2ee0c5ec74360804306d6aad865cd. Status: Network error: Client connection negotiation failed: client connection to 127.10.75.125:46667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 02:42:57.083216 22813 master.cc:552] Master@127.10.75.125:46667 shutdown complete.
I20260812 02:42:57.083294 22813 master_runner.cc:305] Clearing existing system tablet
I20260812 02:42:57.083541 22813 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:57.083619 22813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:57.085016 22813 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 02:42:57.086633 23020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:57.087122 22813 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:57.087258 22813 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:42:57.087311 22813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/wal
uuid: "9be2ee0c5ec74360804306d6aad865cd"
format_stamp: "Formatted at 2026-08-12 02:42:56 on dist-test-slave-2p8l"
server_key: "e384990491706d071b270d80ffd08ee1"
server_key_iv: "4638fb2ed7c66a49b973be0d8f9bb284"
server_key_version: "encryptionkey@0"
I20260812 02:42:57.089301 22813 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: Deleting tablet data with delete state TABLET_DATA_DELETED
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.75.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.124.keytab.
Entry for principal oryx/127.10.75.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.124.keytab.
I20260812 02:42:57.091159 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.124:42665
--webserver_interface=127.10.75.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.124.keytab
--principal=oryx/127.10.75.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:46185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:34761,127.10.75.125:46667,127.10.75.124:42665
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:42:57.092550 22813 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 02:42:57.092664 22813 log.cc:1196] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 02:42:57.092976 22813 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: Deleting consensus metadata
I20260812 02:42:57.093196 22813 master_runner.cc:315] Copying system tablet from 127.10.75.126:34761
I20260812 02:42:57.094693 22813 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: tablet copy: Beginning tablet copy session from remote peer at address 127.10.75.126:34761
I20260812 02:42:57.108441 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.095467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59674 (local address 127.10.75.126:34761)
0812 02:42:57.095627 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.095632 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.098392 (+ 2760us) server_negotiation.cc:407] Connection header received
0812 02:42:57.098524 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.098528 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.098602 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.098725 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:57.099327 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.100348 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.101670 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.102162 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.102312 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.103864 (+ 1552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.103871 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.103878 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.103919 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.106272 (+ 2353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.106828 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.106832 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.106834 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.106932 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.107447 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.107451 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.107453 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.107691 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.107800 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.108134 (+ 334us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.108268 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 02:42:57.108445 23030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.095332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.0.0.1:59674)
0812 02:42:57.098263 (+ 2931us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.098280 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.098412 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.098759 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.098762 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.099012 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:57.099170 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.099179 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.100500 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.100505 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.101510 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.101522 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.102307 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.102312 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.102422 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.103111 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:57.103127 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:57.103604 (+ 477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:57.106410 (+ 2806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.106414 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.106417 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.106705 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.107113 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.107117 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.107120 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.107247 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.107809 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:57.107812 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:57.107925 (+ 113us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.108058 (+ 133us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.108210 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2848,"thread_start_us":93,"threads_started":1}
I20260812 02:42:57.109637 21943 tablet_copy_service.cc:140] P c62d7bb434ff489f9f7fa8e977d85c14: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 9be2ee0c5ec74360804306d6aad865cd ({username='oryx', principal='oryx/127.10.75.125@KRBTEST.COM'} at 127.0.0.1:59674)
I20260812 02:42:57.109850 21943 tablet_copy_service.cc:161] P c62d7bb434ff489f9f7fa8e977d85c14: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 9be2ee0c5ec74360804306d6aad865cd at {username='oryx', principal='oryx/127.10.75.125@KRBTEST.COM'} at 127.0.0.1:59674: session id = 9be2ee0c5ec74360804306d6aad865cd-00000000000000000000000000000000
I20260812 02:42:57.112150 21943 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 02:42:57.114315 22813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 02:42:57.117194 22813 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: tablet copy: Starting download of 0 data blocks...
I20260812 02:42:57.117499 22813 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: tablet copy: Starting download of 1 WAL segments...
I20260812 02:42:57.119597 22813 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 02:42:57.121589 21943 tablet_copy_service.cc:342] P c62d7bb434ff489f9f7fa8e977d85c14: Request end of tablet copy session 9be2ee0c5ec74360804306d6aad865cd-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.10.75.125@KRBTEST.COM'} at 127.0.0.1:59674
I20260812 02:42:57.121778 21943 tablet_copy_service.cc:433] P c62d7bb434ff489f9f7fa8e977d85c14: ending tablet copy session 9be2ee0c5ec74360804306d6aad865cd-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 9be2ee0c5ec74360804306d6aad865cd
I20260812 02:42:57.130733 22813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:57.132625 23045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:57.132718 23031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:57.132973 23032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:57.133374 22813 server_base.cc:1034] running on GCE node
I20260812 02:42:57.133538 22813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:57.133863 22813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:57.135038 22813 hybrid_clock.cc:648] HybridClock initialized: now 1786502577135011 us; error 44 us; skew 500 ppm
Aug 12 02:42:57 dist-test-slave-2p8l krb5kdc[21829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502577, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:57.136863 22813 init.cc:377] Logged in from keytab as oryx/127.10.75.125@KRBTEST.COM (short username oryx)
I20260812 02:42:57.137408 22813 webserver.cc:460] Webserver started at http://127.10.75.125:42033/ using document root <none> and password file <none>
I20260812 02:42:57.137634 22813 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:57.137687 22813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:57.139254 22813 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 02:42:57.140393 23055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:57.140745 22813 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 02:42:57.140828 22813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/wal
uuid: "9be2ee0c5ec74360804306d6aad865cd"
format_stamp: "Formatted at 2026-08-12 02:42:56 on dist-test-slave-2p8l"
server_key: "e384990491706d071b270d80ffd08ee1"
server_key_iv: "4638fb2ed7c66a49b973be0d8f9bb284"
server_key_version: "encryptionkey@0"
I20260812 02:42:57.140914 22813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:57.175598 22813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:57.178094 22813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:57.183506 22813 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.125:46667
I20260812 02:42:57.183542 23158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.125:46667 every 8 connection(s)
I20260812 02:42:57.184185 22813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-1/data/info.pb
I20260812 02:42:57.186273 23160 sys_catalog.cc:263] Verifying existing consensus state
I20260812 02:42:57.187765 23160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: Bootstrap starting.
I20260812 02:42:57.198618 23160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 02:42:57.198899 23160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: Bootstrap complete.
I20260812 02:42:57.199437 23160 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: NON_VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: true } }
I20260812 02:42:57.199568 23160 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9be2ee0c5ec74360804306d6aad865cd, State: Initialized, Role: LEARNER
I20260812 02:42:57.199658 23160 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: NON_VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: true } }
I20260812 02:42:57.200067 23160 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:42:57.199975 23164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: NON_VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: true } } }
I20260812 02:42:57.200286 23164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [sys.catalog]: This master's current role is: LEARNER
I20260812 02:42:57.203006 23182 catalog_manager.cc:1259] Loaded cluster ID: aa7a20c8e90a4c46a42e4879721e8d83
I20260812 02:42:57.203135 23182 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: loading cluster ID for follower catalog manager: success
I20260812 02:42:57.205777 23182 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: acquiring CA information for follower catalog manager: success
I20260812 02:42:57.207278 23182 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 02:42:57.238330 23021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:57.238569 23021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:57.238615 23021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:57.242801 23021 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:42:57.242852 23021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:57.242872 23021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:57.242889 23021 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:42:57.242904 23021 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:42:57.248044 23021 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:46185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:34761,127.10.75.125:46667,127.10.75.124:42665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.124.keytab
--principal=oryx/127.10.75.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.124:42665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.75.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:57.248940 23021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:57.249902 23021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:57.258219 23191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:57.258210 23195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:57.258489 23021 server_base.cc:1034] running on GCE node
W20260812 02:42:57.258210 23190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:57.259194 23021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:57.260167 23021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:57.261333 23021 hybrid_clock.cc:648] HybridClock initialized: now 1786502577261311 us; error 30 us; skew 500 ppm
Aug 12 02:42:57 dist-test-slave-2p8l krb5kdc[21829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502577, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:57.264196 23021 init.cc:377] Logged in from keytab as oryx/127.10.75.124@KRBTEST.COM (short username oryx)
I20260812 02:42:57.264995 23021 webserver.cc:460] Webserver started at http://127.10.75.124:42019/ using document root <none> and password file <none>
I20260812 02:42:57.265486 23021 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:57.265544 23021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:57.265702 23021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:42:57.267675 23021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/data/instance:
uuid: "7cc75143287a482897caab3513bd73e9"
format_stamp: "Formatted at 2026-08-12 02:42:57 on dist-test-slave-2p8l"
server_key: "2e7f51b97a81b172c7033e1dcb3e9073"
server_key_iv: "b1a5922980dd2e6c299d3a6c50124768"
server_key_version: "encryptionkey@0"
I20260812 02:42:57.268187 23021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/wal/instance:
uuid: "7cc75143287a482897caab3513bd73e9"
format_stamp: "Formatted at 2026-08-12 02:42:57 on dist-test-slave-2p8l"
server_key: "2e7f51b97a81b172c7033e1dcb3e9073"
server_key_iv: "b1a5922980dd2e6c299d3a6c50124768"
server_key_version: "encryptionkey@0"
I20260812 02:42:57.271831 23021 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260812 02:42:57.274015 23207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:57.275516 23021 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 02:42:57.275668 23021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/wal
uuid: "7cc75143287a482897caab3513bd73e9"
format_stamp: "Formatted at 2026-08-12 02:42:57 on dist-test-slave-2p8l"
server_key: "2e7f51b97a81b172c7033e1dcb3e9073"
server_key_iv: "b1a5922980dd2e6c299d3a6c50124768"
server_key_version: "encryptionkey@0"
I20260812 02:42:57.275772 23021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:57.313949 22260 heartbeater.cc:503] Master 127.10.75.126:34761 was elected leader, sending a full tablet report...
I20260812 02:42:57.329351 23021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:57.332386 23021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:57.332547 23021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:57.339699 23021 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.124:42665
I20260812 02:42:57.340006 23300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.124:42665 every 8 connection(s)
I20260812 02:42:57.340682 23021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/data/info.pb
I20260812 02:42:57.340998 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 23021
I20260812 02:42:57.343947 23303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:57.347693 23303 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 02:42:57 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.75.124@KRBTEST.COM
Aug 12 02:42:57 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502577, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.124@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM
I20260812 02:42:57.356355 23307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.342555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53912 (local address 127.10.75.124:42665)
0812 02:42:57.342981 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.343002 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.343043 (+ 41us) server_negotiation.cc:407] Connection header received
0812 02:42:57.343802 (+ 759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.343819 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.344193 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.344560 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:57.345345 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.346676 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.347607 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.348137 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.348317 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.351381 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.351398 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.351406 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.351431 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.353278 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.353773 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.353779 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.353784 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.353898 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.354243 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.354246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.354247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.354571 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.354821 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.355109 (+ 288us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.355378 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":147,"threads_started":1}
I20260812 02:42:57.359014 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.349412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59686 (local address 127.10.75.126:34761)
0812 02:42:57.349584 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.349592 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.349803 (+ 211us) server_negotiation.cc:407] Connection header received
0812 02:42:57.349926 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.349931 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.349997 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.350124 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:57.350967 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.351468 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.352704 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.353035 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.353151 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.355581 (+ 2430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.355593 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.355596 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.355624 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.357095 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.357635 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.357639 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.357641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.357751 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.358087 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.358091 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.358092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.358348 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.358448 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.358784 (+ 336us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.358894 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 02:42:57.359048 23309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.349257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.0.0.1:59686)
0812 02:42:57.349667 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.349712 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.349825 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.350193 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.350202 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.350647 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:57.350824 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.350835 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.351606 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.351609 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.352573 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.352583 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.353154 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.353158 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.353275 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.353809 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:57.353827 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:57.355440 (+ 1613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:57.357211 (+ 1771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.357219 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.357223 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.357513 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.357869 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.357872 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.357874 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.357963 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.358462 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:57.358468 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:57.358564 (+ 96us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.358681 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.358891 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":185,"threads_started":1}
I20260812 02:42:57.359974 23303 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 02:42:57 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502577, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.124@KRBTEST.COM for oryx/127.10.75.125@KRBTEST.COM
I20260812 02:42:57.367720 23309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.360439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:46667 (local address 127.0.0.1:44074)
0812 02:42:57.360557 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.360571 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.360680 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.361081 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.361083 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.361209 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:57.361289 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.361293 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.362256 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.362259 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.362756 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.362763 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.363187 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.363189 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.363257 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.363627 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:57.363638 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:57.364781 (+ 1143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:57.366562 (+ 1781us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.366565 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.366566 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.366743 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.366984 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.366986 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.366988 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.367054 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.367377 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:57.367379 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:57.367446 (+ 67us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.367524 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.367620 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 02:42:57.367802 23312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.360568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44074 (local address 127.10.75.125:46667)
0812 02:42:57.360868 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.360872 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.360884 (+ 12us) server_negotiation.cc:407] Connection header received
0812 02:42:57.360921 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.360923 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.360959 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.361051 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:57.361390 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.362155 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.362861 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.363088 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.363169 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.364910 (+ 1741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.364913 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.364915 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.364938 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.366469 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.366830 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.366832 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.366834 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.366907 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.367135 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.367137 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.367138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.367296 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.367372 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.367584 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.367677 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":121,"threads_started":1}
I20260812 02:42:57.368487 23303 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 02:42:57 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502577, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.124@KRBTEST.COM for oryx/127.10.75.124@KRBTEST.COM
I20260812 02:42:57.375805 23309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.368951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:42665 (local address 127.0.0.1:53922)
0812 02:42:57.369064 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.369083 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.369143 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.369321 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.369323 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.369438 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:57.369499 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.369503 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.370609 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.370612 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.371090 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.371099 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.371480 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.371482 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.371535 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.371933 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:57.371943 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:57.372998 (+ 1055us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:57.374669 (+ 1671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.374672 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.374673 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.374843 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.375080 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.375082 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.375083 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.375154 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.375462 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:57.375464 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:57.375529 (+ 65us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.375615 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.375709 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 02:42:57.375945 23307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.369011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53922 (local address 127.10.75.124:42665)
0812 02:42:57.369131 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.369134 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.369145 (+ 11us) server_negotiation.cc:407] Connection header received
0812 02:42:57.369198 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.369200 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.369230 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.369293 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:57.369590 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.370485 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.371188 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.371390 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.371464 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.373121 (+ 1657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.373124 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.373126 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.373147 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.374575 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.374929 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.374931 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.374932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.375000 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.375232 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.375234 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.375235 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.375382 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.375456 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.375649 (+ 193us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.375784 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":49}
I20260812 02:42:57.378600 23303 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: Bootstrap starting.
I20260812 02:42:57.380915 23303 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:57.381633 23303 log.cc:824] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:57.383452 23303 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: No bootstrap required, opened a new log
I20260812 02:42:57.386469 23303 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } }
I20260812 02:42:57.386686 23303 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:57.386770 23303 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cc75143287a482897caab3513bd73e9, State: Initialized, Role: FOLLOWER
I20260812 02:42:57.387174 23303 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } }
I20260812 02:42:57.387610 23315 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } } }
I20260812 02:42:57.387722 23315 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:42:57.388334 23303 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 02:42:57.392917 23334 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:42:57.393039 23334 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:42:57.396920 23021 master_runner.cc:428] Detected that this master 7cc75143287a482897caab3513bd73e9 is joining an existing cluster
I20260812 02:42:57.396981 23021 master_runner.cc:432] Initiating AddMaster RPC to add 127.10.75.124:42665
I20260812 02:42:57.409610 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 22023
I20260812 02:42:57.434909 23312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.399429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44078 (local address 127.10.75.125:46667)
0812 02:42:57.399547 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.399551 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.399861 (+ 310us) server_negotiation.cc:407] Connection header received
0812 02:42:57.400048 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.400051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.400119 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.400173 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:57.400889 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.401703 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.404143 (+ 2440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.404606 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.404697 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.430604 (+ 25907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.430611 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.430616 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.430661 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.432329 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.433091 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.433097 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.433101 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.433196 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.433526 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.433529 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.433531 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.433795 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.433907 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.434483 (+ 576us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.434679 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 02:42:57.435756 23349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.399287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:46667 (local address 127.0.0.1:44078)
0812 02:42:57.399779 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.399793 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.399939 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.400317 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.400320 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.400602 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:57.400748 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.400757 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.401852 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.401855 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.403958 (+ 2103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.403965 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.404855 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.404859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.404956 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.405346 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:57.405362 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:57.430409 (+ 25047us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:57.432554 (+ 2145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.432561 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.432565 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.432979 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.433311 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.433316 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.433319 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.433417 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.434013 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:57.434018 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:57.434201 (+ 183us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.435351 (+ 1150us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.435518 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"mutex_wait_us":266,"spinlock_wait_cycles":3968,"thread_start_us":102,"threads_started":1}
I20260812 02:42:57.436823 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:46729
--local_ip_for_outbound_sockets=127.10.75.65
--tserver_master_addrs=127.10.75.126:34761
--webserver_port=41335
--webserver_interface=127.10.75.65
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.65.keytab
--principal=oryx/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:46185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.75.126:34761,127.10.75.125:46667
--tserver_master_addrs=127.10.75.126:34761,127.10.75.125:46667,127.10.75.124:42665 with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:42:57.437125 23307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.400175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53932 (local address 127.10.75.124:42665)
0812 02:42:57.400290 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.400294 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.400544 (+ 250us) server_negotiation.cc:407] Connection header received
0812 02:42:57.400671 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.400676 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.400717 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.400780 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:57.401394 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.402105 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.403336 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.403689 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.403797 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.429822 (+ 26025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.429829 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.429833 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.429865 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.432262 (+ 2397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.432970 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.432973 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.432974 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.433058 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.435830 (+ 2772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.435835 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.435838 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.436037 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.436110 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.436843 (+ 733us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.436964 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":59}
I20260812 02:42:57.438020 23353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.399854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:42665 (local address 127.0.0.1:53932)
0812 02:42:57.400464 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.400479 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.400576 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.400931 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.400936 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.401126 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:57.401243 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.401249 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.402237 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.402240 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.403211 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.403221 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.403819 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.403823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.403923 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.404520 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:57.404539 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:57.429639 (+ 25100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:57.432438 (+ 2799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.432444 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.432449 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.432866 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.433172 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.433175 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.433177 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.433266 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.436339 (+ 3073us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:57.436343 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:57.436432 (+ 89us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.437683 (+ 1251us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.437826 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"mutex_wait_us":58,"spinlock_wait_cycles":112384,"thread_start_us":81,"threads_started":1}
I20260812 02:42:57.439307 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.399334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59690 (local address 127.10.75.126:34761)
0812 02:42:57.399457 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.399462 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.399861 (+ 399us) server_negotiation.cc:407] Connection header received
0812 02:42:57.400076 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.400080 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.400156 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.400212 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:57.401108 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.401932 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.403416 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.403702 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.403798 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.433568 (+ 29770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.433575 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.433595 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.433625 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.435509 (+ 1884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.437706 (+ 2197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.437709 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.437711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.437808 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.438370 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.438374 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.438375 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.438610 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.438700 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.439065 (+ 365us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.439194 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 02:42:57.439906 23351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.399283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.0.0.1:59690)
0812 02:42:57.399780 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.399795 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.399950 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.400417 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.400419 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.400803 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:57.400970 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.400982 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.402115 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.402118 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.403211 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.403221 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.403943 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.403946 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.404044 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.404924 (+ 880us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:57.404936 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:57.433366 (+ 28430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:57.435646 (+ 2280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.435648 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.435651 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.436690 (+ 1039us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.437922 (+ 1232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.437925 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.437927 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.438007 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.438775 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:57.438778 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:57.438865 (+ 87us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.439535 (+ 670us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.439676 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"mutex_wait_us":94,"spinlock_wait_cycles":8192,"thread_start_us":100,"threads_started":1}
Aug 12 02:42:57 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502575, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.126@KRBTEST.COM for oryx/127.10.75.124@KRBTEST.COM
I20260812 02:42:57.451344 23307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.443633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53942 (local address 127.10.75.124:42665)
0812 02:42:57.443736 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.443740 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.443844 (+ 104us) server_negotiation.cc:407] Connection header received
0812 02:42:57.444005 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.444008 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.444057 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.444153 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:57.444549 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.445029 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.445838 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.446193 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.446313 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.448315 (+ 2002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.448319 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.448321 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.448344 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.449729 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.450195 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.450199 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.450200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.450279 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.450579 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.450584 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.450586 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.450748 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.450856 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.451114 (+ 258us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.451209 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 02:42:57.451354 23004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.443588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:42665 (local address 127.0.0.1:53942)
0812 02:42:57.443771 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.443784 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.443885 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.444160 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.444163 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.444339 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:57.444419 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.444424 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.445141 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.445145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.445683 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.445692 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.446313 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.446317 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.446412 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.446858 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:57.446879 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:57.448181 (+ 1302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:57.449848 (+ 1667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.449853 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.449855 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.450049 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.450386 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.450389 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.450391 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.450485 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.450850 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:57.450853 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:57.450951 (+ 98us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.451063 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.451210 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115}
I20260812 02:42:57.452510 21912 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.10.75.124:42665: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "7cc75143287a482897caab3513bd73e9"
member_type: NON_VOTER
last_known_addr {
host: "127.10.75.124"
port: 42665
}
attrs {
promote: true
}
}
dest_uuid: "c62d7bb434ff489f9f7fa8e977d85c14"
cas_config_opid_index: 5
I20260812 02:42:57.453066 21912 consensus_queue.cc:237] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: NON_VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: true } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: NON_VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: true } }
I20260812 02:42:57.454183 23008 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 7cc75143287a482897caab3513bd73e9 (127.10.75.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: NON_VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: true } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: NON_VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: true } } }
I20260812 02:42:57.455500 23008 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.10.75.124:42665
I20260812 02:42:57.455658 23008 sys_catalog.cc:455] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: NON_VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: true } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: NON_VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: true } } }
I20260812 02:42:57.455785 23008 sys_catalog.cc:458] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:57.456542 23258 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:57.456779 23021 master.cc:537] Master@127.10.75.124:42665 shutting down...
I20260812 02:42:57.458303 23258 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 1 FOLLOWER]: Refusing update from remote peer c62d7bb434ff489f9f7fa8e977d85c14: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 02:42:57.459167 23009 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: NON_VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 02:42:57.461282 21885 consensus_peers.cc:487] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 -> Peer 7cc75143287a482897caab3513bd73e9 (127.10.75.124:42665): Couldn't send request to peer 7cc75143287a482897caab3513bd73e9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 02:42:57.462572 23021 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:42:57.462859 23021 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:57.462971 23021 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: stopping tablet replica
I20260812 02:42:57.466898 23312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.456455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44086 (local address 127.10.75.125:46667)
0812 02:42:57.456591 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.456596 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.461976 (+ 5380us) server_negotiation.cc:407] Connection header received
0812 02:42:57.462575 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.462581 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.462657 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.462730 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:57.463126 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.463847 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.465336 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.466003 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.466109 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.466283 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.466673 (+ 390us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.466759 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 02:42:57.467383 23004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.456179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:46667 (local address 127.0.0.1:44086)
0812 02:42:57.461896 (+ 5717us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.461912 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.462344 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.462887 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.462891 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.462911 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:57.462990 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.462997 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.463991 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.463994 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.465200 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.465212 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.466386 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.466389 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.466495 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.466548 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.467041 (+ 493us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.467119 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5608}
I20260812 02:42:57.467959 23114 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 1 LEARNER]: Refusing update from remote peer c62d7bb434ff489f9f7fa8e977d85c14: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 02:42:57.468429 23009 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: NON_VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 02:42:57.470230 23114 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 7cc75143287a482897caab3513bd73e9 (127.10.75.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: NON_VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: true } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: NON_VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: true } } }
I20260812 02:42:57.472201 23164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader c62d7bb434ff489f9f7fa8e977d85c14. Latest consensus state: current_term: 1 leader_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: NON_VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: true } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: NON_VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: true } } }
I20260812 02:42:57.472328 23164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [sys.catalog]: This master's current role is: LEARNER
I20260812 02:42:57.472440 23164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: NON_VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: true } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: NON_VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: true } } }
I20260812 02:42:57.472509 23164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [sys.catalog]: This master's current role is: LEARNER
I20260812 02:42:57.473145 23009 raft_consensus.cc:1050] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14: attempting to promote NON_VOTER 9be2ee0c5ec74360804306d6aad865cd to VOTER
I20260812 02:42:57.473361 23021 master.cc:552] Master@127.10.75.124:42665 shutdown complete.
I20260812 02:42:57.473399 23021 master_runner.cc:305] Clearing existing system tablet
I20260812 02:42:57.473634 23021 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:57.473691 23021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:57.473630 23009 consensus_queue.cc:237] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: NON_VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: true } }
I20260812 02:42:57.475216 23021 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 02:42:57.475566 23114 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 1 LEARNER]: Refusing update from remote peer c62d7bb434ff489f9f7fa8e977d85c14: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 02:42:57.475948 23004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.475115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:42665 (local address 127.0.0.1:53944)
0812 02:42:57.475819 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.475880 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:42665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":622}
I20260812 02:42:57.476089 23008 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 02:42:57.476696 23004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.476443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:42665 (local address 127.0.0.1:53950)
0812 02:42:57.476558 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.476634 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:42665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 02:42:57.476824 21885 consensus_peers.cc:487] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 -> Peer 7cc75143287a482897caab3513bd73e9 (127.10.75.124:42665): Couldn't send request to peer 7cc75143287a482897caab3513bd73e9. Status: Network error: Client connection negotiation failed: client connection to 127.10.75.124:42665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 02:42:57.476610 23363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:57.477689 23021 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:57.477959 23009 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 9be2ee0c5ec74360804306d6aad865cd (127.10.75.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: NON_VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: true } } }
I20260812 02:42:57.479250 23009 sys_catalog.cc:455] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: NON_VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: true } } }
I20260812 02:42:57.479357 23009 sys_catalog.cc:458] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:57.479389 23358 sys_catalog.cc:455] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: NON_VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: true } } }
I20260812 02:42:57.479475 23358 sys_catalog.cc:458] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:57.479768 23114 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 9be2ee0c5ec74360804306d6aad865cd (127.10.75.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: NON_VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: true } } }
I20260812 02:42:57.481254 23021 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260812 02:42:57.481319 23021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/wal
uuid: "7cc75143287a482897caab3513bd73e9"
format_stamp: "Formatted at 2026-08-12 02:42:57 on dist-test-slave-2p8l"
server_key: "2e7f51b97a81b172c7033e1dcb3e9073"
server_key_iv: "b1a5922980dd2e6c299d3a6c50124768"
server_key_version: "encryptionkey@0"
I20260812 02:42:57.483358 23021 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:57.485415 23021 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 02:42:57.485525 23021 log.cc:1196] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 02:42:57.485782 23021 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: Deleting consensus metadata
I20260812 02:42:57.485991 23021 master_runner.cc:315] Copying system tablet from 127.10.75.126:34761
I20260812 02:42:57.487202 23021 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.75.126:34761
I20260812 02:42:57.487569 23357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: NON_VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: true } } }
I20260812 02:42:57.487697 23357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:42:57.495626 23373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.487698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.0.0.1:59692)
0812 02:42:57.488272 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.488285 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.488426 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.488704 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.488708 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.488945 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:57.489096 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.489104 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.489990 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.489994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.490666 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.490676 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.491159 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.491163 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.491258 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.491816 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:57.491835 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:57.492155 (+ 320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:57.493950 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.493955 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.493957 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.494245 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.494566 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.494570 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.494571 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.494663 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.495044 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:57.495047 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:57.495155 (+ 108us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.495266 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.495408 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":102,"threads_started":1}
I20260812 02:42:57.495604 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.488086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59692 (local address 127.10.75.126:34761)
0812 02:42:57.488219 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.488224 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.488351 (+ 127us) server_negotiation.cc:407] Connection header received
0812 02:42:57.488540 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.488543 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.488588 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.488688 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:57.489227 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.489859 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.490797 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.491034 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.491149 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.492305 (+ 1156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.492308 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.492311 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.492335 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.493829 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.494348 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.494352 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.494354 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.494458 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.494759 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.494763 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.494765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.494942 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.495053 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.495339 (+ 286us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.495451 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 02:42:57.496376 21943 tablet_copy_service.cc:140] P c62d7bb434ff489f9f7fa8e977d85c14: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 7cc75143287a482897caab3513bd73e9 ({username='oryx', principal='oryx/127.10.75.124@KRBTEST.COM'} at 127.0.0.1:59692)
I20260812 02:42:57.496505 21943 tablet_copy_service.cc:161] P c62d7bb434ff489f9f7fa8e977d85c14: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 7cc75143287a482897caab3513bd73e9 at {username='oryx', principal='oryx/127.10.75.124@KRBTEST.COM'} at 127.0.0.1:59692: session id = 7cc75143287a482897caab3513bd73e9-00000000000000000000000000000000
I20260812 02:42:57.497511 21943 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 02:42:57.498736 23021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 02:42:57.500864 23021 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: tablet copy: Starting download of 0 data blocks...
I20260812 02:42:57.501062 23021 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: tablet copy: Starting download of 1 WAL segments...
I20260812 02:42:57.502534 23021 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 02:42:57.504139 21943 tablet_copy_service.cc:342] P c62d7bb434ff489f9f7fa8e977d85c14: Request end of tablet copy session 7cc75143287a482897caab3513bd73e9-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.10.75.124@KRBTEST.COM'} at 127.0.0.1:59692
I20260812 02:42:57.504241 21943 tablet_copy_service.cc:433] P c62d7bb434ff489f9f7fa8e977d85c14: ending tablet copy session 7cc75143287a482897caab3513bd73e9-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 7cc75143287a482897caab3513bd73e9
I20260812 02:42:57.511281 23021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:57.514227 23380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:57.514232 23377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:57.518268 23021 server_base.cc:1034] running on GCE node
W20260812 02:42:57.519160 23375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:57.519407 23021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:57.519743 23021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:57.520889 23021 hybrid_clock.cc:648] HybridClock initialized: now 1786502577520886 us; error 25 us; skew 500 ppm
Aug 12 02:42:57 dist-test-slave-2p8l krb5kdc[21829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502577, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:57.522432 23021 init.cc:377] Logged in from keytab as oryx/127.10.75.124@KRBTEST.COM (short username oryx)
I20260812 02:42:57.522907 23021 webserver.cc:460] Webserver started at http://127.10.75.124:33157/ using document root <none> and password file <none>
I20260812 02:42:57.523206 23021 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:57.523253 23021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:57.524324 23021 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 02:42:57.525295 23392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:57.525528 23021 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 02:42:57.525617 23021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/wal
uuid: "7cc75143287a482897caab3513bd73e9"
format_stamp: "Formatted at 2026-08-12 02:42:57 on dist-test-slave-2p8l"
server_key: "2e7f51b97a81b172c7033e1dcb3e9073"
server_key_iv: "b1a5922980dd2e6c299d3a6c50124768"
server_key_version: "encryptionkey@0"
I20260812 02:42:57.525729 23021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:57.531039 22528 heartbeater.cc:503] Master 127.10.75.126:34761 was elected leader, sending a full tablet report...
I20260812 02:42:57.532685 23021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:57.534794 23021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:57.539598 23021 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.124:42665
I20260812 02:42:57.540422 23021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/master-2/data/info.pb
I20260812 02:42:57.542124 23491 sys_catalog.cc:263] Verifying existing consensus state
I20260812 02:42:57.542920 23491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: Bootstrap starting.
I20260812 02:42:57.545545 23490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.124:42665 every 8 connection(s)
I20260812 02:42:57.551687 23491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 02:42:57.551975 23491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: Bootstrap complete.
I20260812 02:42:57.552453 23491 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: NON_VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: true } }
I20260812 02:42:57.552600 23491 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7cc75143287a482897caab3513bd73e9, State: Initialized, Role: LEARNER
I20260812 02:42:57.552721 23491 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: NON_VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: true } }
I20260812 02:42:57.553078 23497 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: NON_VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: true } } }
I20260812 02:42:57.553243 23491 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:42:57.553252 23497 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [sys.catalog]: This master's current role is: LEARNER
I20260812 02:42:57.557471 23520 catalog_manager.cc:1259] Loaded cluster ID: aa7a20c8e90a4c46a42e4879721e8d83
I20260812 02:42:57.557560 23520 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: loading cluster ID for follower catalog manager: success
I20260812 02:42:57.559346 23520 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: acquiring CA information for follower catalog manager: success
I20260812 02:42:57.560379 23520 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 02:42:57.609920 23355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:57.610308 23355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:57.610373 23355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:57.617025 23355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:57.617100 23355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:57.617190 23355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:42:57.624989 23355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:46185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.65.keytab
--principal=oryx/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:46729
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=41335
--tserver_master_addrs=127.10.75.126:34761,127.10.75.125:46667,127.10.75.124:42665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:57.626042 23355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:57.627125 23355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:57.637650 23530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:57.637678 23535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:57.637760 23355 server_base.cc:1034] running on GCE node
W20260812 02:42:57.637910 23528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:57.638396 23355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:57.639098 23355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:57.640267 23355 hybrid_clock.cc:648] HybridClock initialized: now 1786502577640229 us; error 47 us; skew 500 ppm
Aug 12 02:42:57 dist-test-slave-2p8l krb5kdc[21829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502577, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:57.643143 23355 init.cc:377] Logged in from keytab as oryx/127.10.75.65@KRBTEST.COM (short username oryx)
I20260812 02:42:57.643966 23355 webserver.cc:460] Webserver started at http://127.10.75.65:41335/ using document root <none> and password file <none>
I20260812 02:42:57.644529 23355 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:57.644660 23355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:57.648276 23355 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.001s
I20260812 02:42:57.650224 23545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:57.651369 23355 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 02:42:57.651508 23355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "edcbf2fd16e943468048d0905f706883"
format_stamp: "Formatted at 2026-08-12 02:42:56 on dist-test-slave-2p8l"
server_key: "791205df7e5ec8f3bbe13b1c1171c595"
server_key_iv: "a41ba1d84ce2531471e7e24e2d34662c"
server_key_version: "encryptionkey@0"
I20260812 02:42:57.652027 23355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:57.662016 23355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:57.664758 23355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:57.664955 23355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:57.665514 23355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:57.666409 23355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:57.666483 23355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:57.666561 23355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:57.666623 23355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:57.675601 23355 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:46729
I20260812 02:42:57.675633 23747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:46729 every 8 connection(s)
I20260812 02:42:57.676541 23355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:42:57.685618 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 23355
I20260812 02:42:57.685810 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 22276
Aug 12 02:42:57 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502577, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM
Aug 12 02:42:57 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502577, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.124@KRBTEST.COM
Aug 12 02:42:57 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502577, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.125@KRBTEST.COM
I20260812 02:42:57.697052 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.678304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:51017 (local address 127.10.75.126:34761)
0812 02:42:57.678444 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.678450 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.679606 (+ 1156us) server_negotiation.cc:407] Connection header received
0812 02:42:57.680821 (+ 1215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.680824 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.680883 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.680965 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:57.682517 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.683066 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.684744 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.685103 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.685206 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.688691 (+ 3485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.688697 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.688703 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.688740 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.691386 (+ 2646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.694979 (+ 3593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.694984 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.694985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.695074 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.695760 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.695764 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.695766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.695999 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.696085 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.696739 (+ 654us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.696876 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 02:42:57.697907 23760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.678304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:42453 (local address 127.10.75.124:42665)
0812 02:42:57.678569 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.678573 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.679604 (+ 1031us) server_negotiation.cc:407] Connection header received
0812 02:42:57.680968 (+ 1364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.680972 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.681035 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.681131 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:57.683252 (+ 2121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.684328 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.685506 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.685906 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.686001 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.689068 (+ 3067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.689072 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.689075 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.689104 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.691035 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.694917 (+ 3882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.694921 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.694924 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.695020 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.695502 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.695509 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.695514 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.695853 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.695978 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.696791 (+ 813us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.697302 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":88,"threads_started":1}
I20260812 02:42:57.698891 23763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.678853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.65:51017)
0812 02:42:57.679430 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.679494 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.680594 (+ 1100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.681175 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.681184 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.681747 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:57.682348 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.682363 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.683219 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.683223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.684614 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.684624 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.685275 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.685278 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.685569 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.686264 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:57.686289 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:57.688470 (+ 2181us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:57.691497 (+ 3027us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.691503 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.691507 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.694864 (+ 3357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.695183 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.695186 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.695187 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.695643 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.696151 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:57.696155 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:57.696441 (+ 286us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.697337 (+ 896us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.697724 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"mutex_wait_us":141,"spinlock_wait_cycles":5376,"thread_start_us":146,"threads_started":1}
I20260812 02:42:57.699232 23766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.678853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:42665 (local address 127.10.75.65:42453)
0812 02:42:57.679430 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.679494 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.680594 (+ 1100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.681177 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.681185 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.681745 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:57.682350 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.682367 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.684452 (+ 2085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.684455 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.685359 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.685373 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.686198 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.686204 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.686326 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.686798 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:57.686819 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:57.688915 (+ 2096us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:57.691165 (+ 2250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.691174 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.691191 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.694785 (+ 3594us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.695160 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.695164 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.695166 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.695356 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.696052 (+ 696us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:57.696062 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:57.696467 (+ 405us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.698105 (+ 1638us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.698306 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"mutex_wait_us":110,"spinlock_wait_cycles":84224,"thread_start_us":129,"threads_started":1}
I20260812 02:42:57.700937 23312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.680021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:44333 (local address 127.10.75.125:46667)
0812 02:42:57.680136 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.680141 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.680331 (+ 190us) server_negotiation.cc:407] Connection header received
0812 02:42:57.681263 (+ 932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.681266 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.681332 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.681425 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:57.684532 (+ 3107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.685122 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.686392 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.686781 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.686864 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.696636 (+ 9772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.696642 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.696646 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.696680 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.698511 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.699299 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.699302 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.699304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.699395 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.699862 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.699868 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.699873 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.700143 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.700234 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.700653 (+ 419us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.700786 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 02:42:57.701203 23753 heartbeater.cc:347] Connected to a master server at 127.10.75.126:34761
I20260812 02:42:57.701277 23769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.679935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:46667 (local address 127.10.75.65:44333)
0812 02:42:57.680230 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.680242 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.680608 (+ 366us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.681463 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.681466 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.681757 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:57.682350 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.682367 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.685272 (+ 2905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.685275 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.686233 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.686245 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.687022 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.687025 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.687144 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.689091 (+ 1947us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:57.689104 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:57.696460 (+ 7356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:57.698803 (+ 2343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.698806 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.698808 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.699179 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.699615 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.699621 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.699626 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.699761 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.700316 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:57.700322 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:57.700425 (+ 103us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.700551 (+ 126us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.700714 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":160,"spinlock_wait_cycles":34944,"thread_start_us":122,"threads_started":1}
I20260812 02:42:57.701491 23753 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:57.702152 23753 heartbeater.cc:511] Master 127.10.75.126:34761 requested a full tablet report, sending...
I20260812 02:42:57.702255 23754 heartbeater.cc:347] Connected to a master server at 127.10.75.125:46667
I20260812 02:42:57.702348 23754 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:57.702541 23754 heartbeater.cc:511] Master 127.10.75.125:46667 requested a full tablet report, sending...
I20260812 02:42:57.703543 21912 ts_manager.cc:194] Re-registered known tserver with Master: edcbf2fd16e943468048d0905f706883 (127.10.75.65:46729)
I20260812 02:42:57.703737 23090 ts_manager.cc:194] Registered new tserver with Master: edcbf2fd16e943468048d0905f706883 (127.10.75.65:46729)
I20260812 02:42:57.704463 21912 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:51017
I20260812 02:42:57.706349 23750 heartbeater.cc:347] Connected to a master server at 127.10.75.124:42665
I20260812 02:42:57.706432 23750 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:57.706588 23750 heartbeater.cc:511] Master 127.10.75.124:42665 requested a full tablet report, sending...
I20260812 02:42:57.707602 23431 ts_manager.cc:194] Registered new tserver with Master: edcbf2fd16e943468048d0905f706883 (127.10.75.65:46729)
I20260812 02:42:57.707617 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:43595
--local_ip_for_outbound_sockets=127.10.75.66
--tserver_master_addrs=127.10.75.126:34761
--webserver_port=38423
--webserver_interface=127.10.75.66
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.66.keytab
--principal=oryx/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:46185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.75.126:34761,127.10.75.125:46667
--tserver_master_addrs=127.10.75.126:34761,127.10.75.125:46667,127.10.75.124:42665 with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:42:57.744016 22807 heartbeater.cc:503] Master 127.10.75.126:34761 was elected leader, sending a full tablet report...
W20260812 02:42:57.818991 23772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:57.819290 23772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:57.819367 23772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:57.823572 23772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:57.823681 23772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:57.823773 23772 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:42:57.829190 23772 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:46185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.66.keytab
--principal=oryx/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:43595
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=38423
--tserver_master_addrs=127.10.75.126:34761,127.10.75.125:46667,127.10.75.124:42665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:57.830248 23772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:57.831333 23772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:57.841171 23783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:57.841267 23772 server_base.cc:1034] running on GCE node
W20260812 02:42:57.841128 23781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:57.841133 23793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:57.841917 23772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:57.842571 23772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:57.843724 23772 hybrid_clock.cc:648] HybridClock initialized: now 1786502577843693 us; error 44 us; skew 500 ppm
Aug 12 02:42:57 dist-test-slave-2p8l krb5kdc[21829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502577, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:57.846591 23772 init.cc:377] Logged in from keytab as oryx/127.10.75.66@KRBTEST.COM (short username oryx)
I20260812 02:42:57.847481 23772 webserver.cc:460] Webserver started at http://127.10.75.66:38423/ using document root <none> and password file <none>
I20260812 02:42:57.848028 23772 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:57.848145 23772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:57.851887 23772 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 02:42:57.854174 23804 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:57.855765 23772 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 02:42:57.855896 23772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "20594d0fcd92491f82ad39004fd7894f"
format_stamp: "Formatted at 2026-08-12 02:42:56 on dist-test-slave-2p8l"
server_key: "a5ce5f55fac6cb82df52c7db198c9e6f"
server_key_iv: "28ac1b2dc86e3fb306f45066cfca8acf"
server_key_version: "encryptionkey@0"
I20260812 02:42:57.856541 23772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:57.868559 23760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.864890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53956 (local address 127.10.75.124:42665)
0812 02:42:57.865030 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.865034 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.865052 (+ 18us) server_negotiation.cc:407] Connection header received
0812 02:42:57.865159 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.865162 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.865220 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.865308 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:57.865569 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.866212 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.867590 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.868062 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.868154 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.868266 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.868387 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.868456 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 02:42:57.868559 23004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.864801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:42665 (local address 127.0.0.1:53956)
0812 02:42:57.864938 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.864953 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.865051 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.865334 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.865337 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.865353 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:57.865447 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.865452 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.866315 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.866318 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.867457 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.867467 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.868179 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.868182 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.868263 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.868287 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.868357 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.868425 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 02:42:57.869215 23444 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260812 02:42:57.869570 23497 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c62d7bb434ff489f9f7fa8e977d85c14. Latest consensus state: current_term: 1 leader_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: NON_VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: true } } }
I20260812 02:42:57.869752 23497 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [sys.catalog]: This master's current role is: LEARNER
I20260812 02:42:57.876667 23772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:57.879522 23772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:57.879726 23772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:57.880328 23772 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:57.881187 23772 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:57.881234 23772 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:57.881299 23772 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:57.881330 23772 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:57.890889 23772 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:43595
I20260812 02:42:57.890921 24048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:43595 every 8 connection(s)
I20260812 02:42:57.891850 23772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:42:57.894527 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 23772
I20260812 02:42:57.894711 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 22536
Aug 12 02:42:57 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502577, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM
Aug 12 02:42:57 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502577, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.125@KRBTEST.COM
I20260812 02:42:57.921926 23312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.893642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:47197 (local address 127.10.75.125:46667)
0812 02:42:57.893797 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.893803 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.894783 (+ 980us) server_negotiation.cc:407] Connection header received
0812 02:42:57.908960 (+ 14177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.908964 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.909019 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.909119 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:57.911602 (+ 2483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.912351 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.913479 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.913811 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.913892 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.916290 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.916295 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.916298 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.916330 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.918159 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.920004 (+ 1845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.920010 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.920012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.920131 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.920522 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.920526 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.920528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.920765 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.920856 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.921574 (+ 718us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.921717 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 02:42:57.921968 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.893615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:55215 (local address 127.10.75.126:34761)
0812 02:42:57.893773 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.893778 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.905937 (+ 12159us) server_negotiation.cc:407] Connection header received
0812 02:42:57.907478 (+ 1541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.907484 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.907558 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.907613 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:57.909548 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.910302 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.911995 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.912325 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.912420 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.915934 (+ 3514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.915939 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.915942 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.915971 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.919249 (+ 3278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.919967 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.919973 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.919978 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.920071 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.920507 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.920513 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.920518 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.920800 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.920883 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.921590 (+ 707us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.921728 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 02:42:57.923825 24062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.894103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.66:55215)
0812 02:42:57.905834 (+ 11731us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.905851 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.907053 (+ 1202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.907932 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.907942 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.908422 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:57.909052 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.909073 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.910453 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.910458 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.911849 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.911858 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.912646 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.912650 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.912829 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.913554 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:57.913574 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:57.915666 (+ 2092us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:57.919389 (+ 3723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.919395 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.919400 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.919846 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.920189 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.920195 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.920200 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.920388 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.920973 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:57.920979 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:57.921279 (+ 300us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.922643 (+ 1364us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.922872 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11636,"mutex_wait_us":26,"spinlock_wait_cycles":89216,"thread_start_us":183,"threads_started":1}
Aug 12 02:42:57 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502577, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.124@KRBTEST.COM
I20260812 02:42:57.924201 24061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.894091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:46667 (local address 127.10.75.66:47197)
0812 02:42:57.894628 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.894679 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.907274 (+ 12595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.911117 (+ 3843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.911120 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.911334 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:57.911455 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.911462 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.912496 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.912499 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.913324 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.913339 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.914088 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.914092 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.914204 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.914746 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:57.914763 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:57.916103 (+ 1340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:57.919315 (+ 3212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.919322 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.919340 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.919858 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.920260 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.920263 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.920265 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.920394 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.920930 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:57.920937 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:57.921280 (+ 343us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.922155 (+ 875us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.922566 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"spinlock_wait_cycles":24960,"thread_start_us":182,"threads_started":1}
I20260812 02:42:57.925563 24055 heartbeater.cc:347] Connected to a master server at 127.10.75.126:34761
I20260812 02:42:57.925714 24058 heartbeater.cc:347] Connected to a master server at 127.10.75.125:46667
I20260812 02:42:57.925812 24058 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:57.925855 24055 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:57.926043 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:42971
--local_ip_for_outbound_sockets=127.10.75.67
--tserver_master_addrs=127.10.75.126:34761
--webserver_port=33647
--webserver_interface=127.10.75.67
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.67.keytab
--principal=oryx/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:46185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.75.126:34761,127.10.75.125:46667
--tserver_master_addrs=127.10.75.126:34761,127.10.75.125:46667,127.10.75.124:42665 with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:42:57.926463 24055 heartbeater.cc:511] Master 127.10.75.126:34761 requested a full tablet report, sending...
I20260812 02:42:57.926486 24058 heartbeater.cc:511] Master 127.10.75.125:46667 requested a full tablet report, sending...
I20260812 02:42:57.927580 21912 ts_manager.cc:194] Re-registered known tserver with Master: 20594d0fcd92491f82ad39004fd7894f (127.10.75.66:43595)
I20260812 02:42:57.927666 23090 ts_manager.cc:194] Registered new tserver with Master: 20594d0fcd92491f82ad39004fd7894f (127.10.75.66:43595)
I20260812 02:42:57.928326 21912 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:55215
I20260812 02:42:57.929123 23760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.917604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:39113 (local address 127.10.75.124:42665)
0812 02:42:57.917773 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:57.917780 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:57.917799 (+ 19us) server_negotiation.cc:407] Connection header received
0812 02:42:57.917865 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:57.917872 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:57.917939 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:57.918041 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:57.919063 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.919929 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.921292 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.921670 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.921754 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.924593 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:57.924597 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:57.924600 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:57.924634 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:57.926755 (+ 2121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.927431 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.927438 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.927443 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.927553 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:57.927940 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:57.927946 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:57.927949 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:57.928220 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:57.928329 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:57.928762 (+ 433us) server_negotiation.cc:299] Negotiation successful
0812 02:42:57.928911 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 02:42:57.929802 24064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:57.895126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:42665 (local address 127.10.75.66:39113)
0812 02:42:57.909341 (+ 14215us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:57.909356 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:57.909429 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:57.918595 (+ 9166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:57.918598 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:57.918773 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:57.918875 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.918880 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.920084 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.920090 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.921141 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:57.921150 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:57.921946 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:57.921952 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:57.922080 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:57.922643 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:57.922658 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:57.924376 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:57.926973 (+ 2597us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.926980 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.926985 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.927298 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.927693 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:57.927699 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:57.927705 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:57.927809 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:57.928404 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:57.928409 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:57.928536 (+ 127us) client_negotiation.cc:769] Sending connection context
0812 02:42:57.929346 (+ 810us) client_negotiation.cc:240] Negotiation successful
0812 02:42:57.929568 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14135,"mutex_wait_us":5,"thread_start_us":2655,"threads_started":1}
I20260812 02:42:57.930471 24053 heartbeater.cc:347] Connected to a master server at 127.10.75.124:42665
I20260812 02:42:57.930552 24053 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:57.930750 24053 heartbeater.cc:511] Master 127.10.75.124:42665 requested a full tablet report, sending...
I20260812 02:42:57.931459 23431 ts_manager.cc:194] Registered new tserver with Master: 20594d0fcd92491f82ad39004fd7894f (127.10.75.66:43595)
W20260812 02:42:58.051085 24066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:42:58.051355 24066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:42:58.051431 24066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:42:58.055858 24066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:42:58.055935 24066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:42:58.056022 24066 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:42:58.062408 24066 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:46185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.67.keytab
--principal=oryx/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:42971
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=33647
--tserver_master_addrs=127.10.75.126:34761,127.10.75.125:46667,127.10.75.124:42665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:42:58.063489 24066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:42:58.064635 24066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:42:58.074905 24074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:58.074957 24073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:42:58.075176 24079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:42:58.075394 24066 server_base.cc:1034] running on GCE node
I20260812 02:42:58.075773 24066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:42:58.076385 24066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:42:58.077592 24066 hybrid_clock.cc:648] HybridClock initialized: now 1786502578077577 us; error 30 us; skew 500 ppm
Aug 12 02:42:58 dist-test-slave-2p8l krb5kdc[21829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502578, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:42:58.080302 24066 init.cc:377] Logged in from keytab as oryx/127.10.75.67@KRBTEST.COM (short username oryx)
I20260812 02:42:58.081118 24066 webserver.cc:460] Webserver started at http://127.10.75.67:33647/ using document root <none> and password file <none>
I20260812 02:42:58.081669 24066 fs_manager.cc:359] Metadata directory not provided
I20260812 02:42:58.081779 24066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:42:58.085647 24066 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:42:58.087721 24095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:58.088949 24066 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:42:58.089099 24066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "9f5c8fc0597e46b4843cefda11b516bd"
format_stamp: "Formatted at 2026-08-12 02:42:56 on dist-test-slave-2p8l"
server_key: "10d2945d3291b7a209ac54b907172f55"
server_key_iv: "a721462adcee6b99f5ea3b0dea6f2cb7"
server_key_version: "encryptionkey@0"
I20260812 02:42:58.089639 24066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:42:58.106348 24066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:42:58.109305 24066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:42:58.109514 24066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:42:58.110189 24066 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:42:58.111073 24066 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:42:58.111151 24066 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:58.111219 24066 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:42:58.111270 24066 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:42:58.120204 24066 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:42971
I20260812 02:42:58.120231 24296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:42971 every 8 connection(s)
I20260812 02:42:58.121176 24066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:42:58.125365 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 24066
Aug 12 02:42:58 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502578, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.125@KRBTEST.COM
Aug 12 02:42:58 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502578, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM
Aug 12 02:42:58 dist-test-slave-2p8l krb5kdc[21829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502578, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.124@KRBTEST.COM
I20260812 02:42:58.140952 23312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.124484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:36651 (local address 127.10.75.125:46667)
0812 02:42:58.124655 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:58.124660 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:58.124804 (+ 144us) server_negotiation.cc:407] Connection header received
0812 02:42:58.125288 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:58.125292 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:58.125344 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:58.125399 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:58.127454 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.128224 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.129943 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.130315 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.130414 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.133811 (+ 3397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:58.133815 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:58.133818 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:58.133844 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:58.137579 (+ 3735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.138232 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.138238 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.138242 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.138336 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.139131 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.139135 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.139137 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.139421 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:58.139527 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:58.140589 (+ 1062us) server_negotiation.cc:299] Negotiation successful
0812 02:42:58.140708 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83,"spinlock_wait_cycles":1280}
I20260812 02:42:58.141450 24323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.127657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44088 (local address 127.10.75.125:46667)
0812 02:42:58.127959 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:58.127965 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:58.128579 (+ 614us) server_negotiation.cc:407] Connection header received
0812 02:42:58.128623 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:58.128627 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:58.128672 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:58.128753 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:58.130336 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.131118 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.132413 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.132745 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.132828 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.135457 (+ 2629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:58.135463 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:58.135468 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:58.135499 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:58.139370 (+ 3871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.139898 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.139902 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.139903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.139979 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.140298 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.140301 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.140303 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.140513 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:58.140656 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:58.141153 (+ 497us) server_negotiation.cc:299] Negotiation successful
0812 02:42:58.141280 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":229,"thread_start_us":80,"threads_started":1}
I20260812 02:42:58.142648 24306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.124355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:46667 (local address 127.10.75.67:36651)
0812 02:42:58.124709 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:58.124722 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:58.125055 (+ 333us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:58.125793 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:58.125802 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:58.126540 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:58.127262 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:58.127284 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.128381 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.128385 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:58.129791 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:58.129802 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.130600 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.130604 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:58.130792 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.131713 (+ 921us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:58.131733 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:58.133644 (+ 1911us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:58.137715 (+ 4071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:58.137722 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:58.137739 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:58.138121 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:58.138846 (+ 725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:58.138848 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:58.138850 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:58.139021 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:58.139589 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:58.139598 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:58.139915 (+ 317us) client_negotiation.cc:769] Sending connection context
0812 02:42:58.140151 (+ 236us) client_negotiation.cc:240] Negotiation successful
0812 02:42:58.141225 (+ 1074us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":2,"thread_start_us":89,"threads_started":1}
I20260812 02:42:58.142875 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.122966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:33401 (local address 127.10.75.126:34761)
0812 02:42:58.123113 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:58.123118 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:58.124356 (+ 1238us) server_negotiation.cc:407] Connection header received
0812 02:42:58.125344 (+ 988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:58.125349 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:58.125413 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:58.125480 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:58.129022 (+ 3542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.129805 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.131124 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.131431 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.131529 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.136179 (+ 4650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:58.136183 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:58.136186 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:58.136213 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:58.138350 (+ 2137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.138835 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.138839 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.138840 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.138915 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.140708 (+ 1793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.140711 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.140713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.140937 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:58.141027 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:58.142585 (+ 1558us) server_negotiation.cc:299] Negotiation successful
0812 02:42:58.142718 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55,"spinlock_wait_cycles":3328}
I20260812 02:42:58.143620 24302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.123403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:42665 (local address 127.10.75.67:45081)
0812 02:42:58.123896 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:58.123946 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:58.125037 (+ 1091us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:58.125793 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:58.125802 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:58.126530 (+ 728us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:58.130010 (+ 3480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:58.130017 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.132127 (+ 2110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.132131 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:58.133022 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:58.133034 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.134243 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.134247 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:58.134371 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.134838 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:58.134853 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:58.136768 (+ 1915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:58.139003 (+ 2235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:58.139007 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:58.139008 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:58.139288 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:58.139621 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:58.139624 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:58.139625 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:58.139715 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:58.140216 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:58.140222 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:58.140326 (+ 104us) client_negotiation.cc:769] Sending connection context
0812 02:42:58.140448 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 02:42:58.143461 (+ 3013us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"mutex_wait_us":5957,"spinlock_wait_cycles":9984,"thread_start_us":130,"threads_started":1}
I20260812 02:42:58.143857 24300 heartbeater.cc:347] Connected to a master server at 127.10.75.125:46667
I20260812 02:42:58.143926 23760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.122968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:45081 (local address 127.10.75.124:42665)
0812 02:42:58.123151 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:58.123156 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:58.124046 (+ 890us) server_negotiation.cc:407] Connection header received
0812 02:42:58.125288 (+ 1242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:58.125292 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:58.125344 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:58.125399 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:58.131217 (+ 5818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.131936 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.133235 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.133567 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.133673 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.136938 (+ 3265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:58.136943 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:58.136946 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:58.136978 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:58.138855 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.139406 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.139413 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.139418 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.139508 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.139828 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.139832 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.139834 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.140077 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:58.140169 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:58.143160 (+ 2991us) server_negotiation.cc:299] Negotiation successful
0812 02:42:58.143780 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260812 02:42:58.144089 24300 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:58.144116 24305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.123423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.67:33401)
0812 02:42:58.124262 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:58.124279 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:58.125036 (+ 757us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:58.125794 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:58.125802 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:58.126530 (+ 728us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:42:58.128880 (+ 2350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:58.128887 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.130162 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.130165 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:58.130991 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:58.131003 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.133797 (+ 2794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.133800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:58.133917 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.134459 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:42:58.134476 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:42:58.135998 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:42:58.138474 (+ 2476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:58.138479 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:58.138482 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:58.138743 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:58.139021 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:42:58.139024 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:42:58.139026 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:42:58.140597 (+ 1571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:42:58.141091 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:42:58.141095 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:42:58.141179 (+ 84us) client_negotiation.cc:769] Sending connection context
0812 02:42:58.141272 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 02:42:58.141387 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":757,"mutex_wait_us":2166,"thread_start_us":127,"threads_started":1}
I20260812 02:42:58.144678 24300 heartbeater.cc:511] Master 127.10.75.125:46667 requested a full tablet report, sending...
I20260812 02:42:58.144749 24299 heartbeater.cc:347] Connected to a master server at 127.10.75.126:34761
I20260812 02:42:58.144814 24299 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:58.144958 24299 heartbeater.cc:511] Master 127.10.75.126:34761 requested a full tablet report, sending...
I20260812 02:42:58.145598 24329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.128438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59698 (local address 127.10.75.126:34761)
0812 02:42:58.128687 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:58.128693 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:58.128709 (+ 16us) server_negotiation.cc:407] Connection header received
0812 02:42:58.128747 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:58.128750 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:58.128791 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:58.130371 (+ 1580us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:58.130473 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.131566 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.132657 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.132989 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.138542 (+ 5553us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.138676 (+ 134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:58.138679 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:58.138682 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:58.138704 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:58.140759 (+ 2055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.141857 (+ 1098us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.141860 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.141862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.141946 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.142302 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.142305 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.142306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.142525 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:58.143658 (+ 1133us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:58.143735 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 02:42:58.145426 (+ 1691us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"spinlock_wait_cycles":6400,"thread_start_us":76,"threads_started":1}
I20260812 02:42:58.145732 21912 ts_manager.cc:194] Re-registered known tserver with Master: 9f5c8fc0597e46b4843cefda11b516bd (127.10.75.67:42971)
I20260812 02:42:58.146193 23090 ts_manager.cc:194] Registered new tserver with Master: 9f5c8fc0597e46b4843cefda11b516bd (127.10.75.67:42971)
I20260812 02:42:58.146221 24297 heartbeater.cc:347] Connected to a master server at 127.10.75.124:42665
I20260812 02:42:58.146303 24297 heartbeater.cc:464] Registering TS with master...
I20260812 02:42:58.146454 24297 heartbeater.cc:511] Master 127.10.75.124:42665 requested a full tablet report, sending...
I20260812 02:42:58.147177 23431 ts_manager.cc:194] Registered new tserver with Master: 9f5c8fc0597e46b4843cefda11b516bd (127.10.75.67:42971)
I20260812 02:42:58.147214 21912 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:33401
I20260812 02:42:58.150452 24331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.128648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53968 (local address 127.10.75.124:42665)
0812 02:42:58.129205 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:58.129211 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:58.129226 (+ 15us) server_negotiation.cc:407] Connection header received
0812 02:42:58.129268 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:58.129274 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:58.129328 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:58.130207 (+ 879us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:58.133328 (+ 3121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.134164 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.136930 (+ 2766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.137337 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.137492 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.146876 (+ 9384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:58.146880 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:58.146882 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:58.146906 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:58.148757 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.149189 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.149194 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.149195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.149283 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.149579 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.149583 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.149585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.149765 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:58.149905 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:58.150174 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 02:42:58.150289 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":76,"threads_started":1}
I20260812 02:42:58.149539 21912 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59698:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:42:58.153026 21912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:42:58.155922 23358 sys_catalog.cc:455] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: NON_VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: true } } }
I20260812 02:42:58.156072 23358 sys_catalog.cc:458] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:58.159495 24334 raft_consensus.cc:1050] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14: attempting to promote NON_VOTER 7cc75143287a482897caab3513bd73e9 to VOTER
I20260812 02:42:58.159902 24334 consensus_queue.cc:237] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: false } }
I20260812 02:42:58.161134 23114 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 1 FOLLOWER]: Refusing update from remote peer c62d7bb434ff489f9f7fa8e977d85c14: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 02:42:58.161509 23358 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 02:42:58.161630 23444 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 1 LEARNER]: Refusing update from remote peer c62d7bb434ff489f9f7fa8e977d85c14: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 02:42:58.162189 23358 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 02:42:58.163498 24335 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 7cc75143287a482897caab3513bd73e9 (127.10.75.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: false } } }
I20260812 02:42:58.163977 23114 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 7cc75143287a482897caab3513bd73e9 (127.10.75.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: false } } }
I20260812 02:42:58.165139 24334 sys_catalog.cc:455] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: false } } }
I20260812 02:42:58.165176 24335 sys_catalog.cc:455] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: false } } }
I20260812 02:42:58.165252 24334 sys_catalog.cc:458] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:58.165287 24335 sys_catalog.cc:458] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:58.165867 23444 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 7cc75143287a482897caab3513bd73e9 (127.10.75.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: false } } }
I20260812 02:42:58.166641 24334 sys_catalog.cc:455] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: false } } }
I20260812 02:42:58.166735 24334 sys_catalog.cc:458] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:58.167789 24352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: false } } }
I20260812 02:42:58.167937 24352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:42:58.167876 23497 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: false } } }
I20260812 02:42:58.167979 23497 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:42:58.177035 24357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.170632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:42971 (local address 127.0.0.1:42850)
0812 02:42:58.171334 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:58.171347 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:58.171432 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:58.172510 (+ 1078us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:58.172513 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:58.172532 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:58.172683 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:58.172692 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.174274 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.174277 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:58.175454 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:58.175465 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.176558 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.176563 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:58.176667 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.176728 (+ 61us) client_negotiation.cc:769] Sending connection context
0812 02:42:58.176799 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 02:42:58.176874 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"mutex_wait_us":50,"thread_start_us":199,"threads_started":1}
I20260812 02:42:58.177201 23004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.170408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:43595 (local address 127.0.0.1:50778)
0812 02:42:58.171014 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:58.171031 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:58.171125 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:58.172592 (+ 1467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:58.172594 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:58.172627 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:58.172736 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:58.172743 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.174048 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.174052 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:58.175321 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:58.175364 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.176758 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.176761 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:58.176845 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.176869 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 02:42:58.176935 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 02:42:58.177001 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"mutex_wait_us":1}
I20260812 02:42:58.177402 24355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.170577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50778 (local address 127.10.75.66:43595)
0812 02:42:58.172088 (+ 1511us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:58.172102 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:58.172129 (+ 27us) server_negotiation.cc:407] Connection header received
0812 02:42:58.172214 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:58.172220 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:58.172420 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:58.172902 (+ 482us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:58.173064 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.173928 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.175855 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.176595 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.176750 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.176898 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:58.176960 (+ 62us) server_negotiation.cc:299] Negotiation successful
0812 02:42:58.177041 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1405,"thread_start_us":142,"threads_started":1}
I20260812 02:42:58.177593 24359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.171331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42850 (local address 127.10.75.67:42971)
0812 02:42:58.172008 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:58.172020 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:58.172042 (+ 22us) server_negotiation.cc:407] Connection header received
0812 02:42:58.172127 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:58.172133 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:58.172373 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:58.172545 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:58.172948 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.174142 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.175591 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.176413 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.176522 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.176676 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:58.177339 (+ 663us) server_negotiation.cc:299] Negotiation successful
0812 02:42:58.177448 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":130,"threads_started":1}
I20260812 02:42:58.178009 24358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.170941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54092 (local address 127.10.75.65:46729)
0812 02:42:58.171771 (+ 830us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:58.171789 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:58.171816 (+ 27us) server_negotiation.cc:407] Connection header received
0812 02:42:58.173100 (+ 1284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:58.173105 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:58.173294 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:58.173443 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:58.173697 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.174826 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.176237 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.176992 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.177065 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.177403 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:58.177768 (+ 365us) server_negotiation.cc:299] Negotiation successful
0812 02:42:58.177869 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":691,"thread_start_us":90,"threads_started":1}
I20260812 02:42:58.178443 24356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.170757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:46729 (local address 127.0.0.1:54092)
0812 02:42:58.171611 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:58.171623 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:58.172936 (+ 1313us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:58.173463 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:58.173466 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:58.173486 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:58.173569 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:58.173574 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.174957 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.174960 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:58.176081 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:58.176092 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.177511 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.177516 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:58.177604 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.177624 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 02:42:58.178191 (+ 567us) client_negotiation.cc:240] Negotiation successful
0812 02:42:58.178299 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":795,"mutex_wait_us":3,"thread_start_us":110,"threads_started":1}
I20260812 02:42:58.180277 23913 tablet_service.cc:1467] Processing CreateTablet for tablet 130242cb52be444490e43c08b0f59b57 (DEFAULT_TABLE table=test-table [id=47ae7ef3df4d4023976165a1141f9b5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:58.180260 24182 tablet_service.cc:1467] Processing CreateTablet for tablet 130242cb52be444490e43c08b0f59b57 (DEFAULT_TABLE table=test-table [id=47ae7ef3df4d4023976165a1141f9b5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:58.181200 24182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 130242cb52be444490e43c08b0f59b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:58.181202 23913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 130242cb52be444490e43c08b0f59b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:58.184633 23623 tablet_service.cc:1467] Processing CreateTablet for tablet 130242cb52be444490e43c08b0f59b57 (DEFAULT_TABLE table=test-table [id=47ae7ef3df4d4023976165a1141f9b5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:42:58.185681 23623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 130242cb52be444490e43c08b0f59b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:42:58.189925 24363 tablet_bootstrap.cc:492] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd: Bootstrap starting.
I20260812 02:42:58.190508 24360 tablet_bootstrap.cc:492] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f: Bootstrap starting.
I20260812 02:42:58.192189 24363 tablet_bootstrap.cc:654] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:58.192648 24360 tablet_bootstrap.cc:654] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:58.193111 24363 log.cc:824] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:58.193470 24360 log.cc:824] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:58.195185 24363 tablet_bootstrap.cc:492] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd: No bootstrap required, opened a new log
I20260812 02:42:58.195365 24363 ts_tablet_manager.cc:1397] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260812 02:42:58.195680 24360 tablet_bootstrap.cc:492] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f: No bootstrap required, opened a new log
I20260812 02:42:58.195881 24360 ts_tablet_manager.cc:1397] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 02:42:58.198503 24370 tablet_bootstrap.cc:492] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883: Bootstrap starting.
I20260812 02:42:58.199452 24363 raft_consensus.cc:348] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } } peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } }
I20260812 02:42:58.199724 24363 raft_consensus.cc:374] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:58.199783 24363 raft_consensus.cc:729] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5c8fc0597e46b4843cefda11b516bd, State: Initialized, Role: FOLLOWER
I20260812 02:42:58.199800 24360 raft_consensus.cc:348] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } } peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } }
I20260812 02:42:58.200045 24360 raft_consensus.cc:374] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:58.200105 24360 raft_consensus.cc:729] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20594d0fcd92491f82ad39004fd7894f, State: Initialized, Role: FOLLOWER
I20260812 02:42:58.200325 24363 consensus_queue.cc:260] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } } peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } }
I20260812 02:42:58.200546 24360 consensus_queue.cc:260] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } } peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } }
I20260812 02:42:58.201061 24370 tablet_bootstrap.cc:654] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883: Neither blocks nor log segments found. Creating new log.
I20260812 02:42:58.201448 24363 ts_tablet_manager.cc:1428] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20260812 02:42:58.201632 24360 ts_tablet_manager.cc:1428] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 02:42:58.201872 24299 heartbeater.cc:503] Master 127.10.75.126:34761 was elected leader, sending a full tablet report...
I20260812 02:42:58.201857 24370 log.cc:824] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883: Log is configured to *not* fsync() on all Append() calls
I20260812 02:42:58.204270 24055 heartbeater.cc:503] Master 127.10.75.126:34761 was elected leader, sending a full tablet report...
I20260812 02:42:58.205143 24370 tablet_bootstrap.cc:492] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883: No bootstrap required, opened a new log
I20260812 02:42:58.205356 24370 ts_tablet_manager.cc:1397] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260812 02:42:58.209052 24370 raft_consensus.cc:348] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } } peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } }
I20260812 02:42:58.209252 24370 raft_consensus.cc:374] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:42:58.209329 24370 raft_consensus.cc:729] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcbf2fd16e943468048d0905f706883, State: Initialized, Role: FOLLOWER
I20260812 02:42:58.209750 24370 consensus_queue.cc:260] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } } peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } }
I20260812 02:42:58.210786 24370 ts_tablet_manager.cc:1428] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260812 02:42:58.211033 23753 heartbeater.cc:503] Master 127.10.75.126:34761 was elected leader, sending a full tablet report...
I20260812 02:42:58.344122 24373 raft_consensus.cc:482] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:42:58.344352 24373 raft_consensus.cc:504] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } } peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } }
I20260812 02:42:58.345592 24373 leader_election.cc:288] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edcbf2fd16e943468048d0905f706883 (127.10.75.65:46729), 9f5c8fc0597e46b4843cefda11b516bd (127.10.75.67:42971)
I20260812 02:42:58.350678 24358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.345947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:48081 (local address 127.10.75.65:46729)
0812 02:42:58.346122 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:58.346127 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:58.346183 (+ 56us) server_negotiation.cc:407] Connection header received
0812 02:42:58.346248 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:58.346253 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:58.346308 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:58.346388 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:58.346825 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.347607 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.349348 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.349937 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.350095 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.350166 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:58.350474 (+ 308us) server_negotiation.cc:299] Negotiation successful
0812 02:42:58.350544 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 02:42:58.350683 24359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.346117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:34555 (local address 127.10.75.67:42971)
0812 02:42:58.346237 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:58.346242 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:58.346254 (+ 12us) server_negotiation.cc:407] Connection header received
0812 02:42:58.346303 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:58.346306 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:58.346356 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:58.346448 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:58.346824 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.347608 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.349348 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.349968 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.350097 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.350150 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:58.350474 (+ 324us) server_negotiation.cc:299] Negotiation successful
0812 02:42:58.350544 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 02:42:58.350735 24064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.345788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:46729 (local address 127.10.75.66:48081)
0812 02:42:58.345955 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:58.345972 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:58.346111 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:58.346436 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:58.346439 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:58.346465 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:58.346686 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:58.346694 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.347735 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.347739 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:58.349202 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:58.349215 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.350114 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.350117 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:58.350331 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.350368 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 02:42:58.350440 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 02:42:58.350558 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":216,"spinlock_wait_cycles":9216}
I20260812 02:42:58.350735 24062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.345943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:42971 (local address 127.10.75.66:34555)
0812 02:42:58.346144 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:58.346159 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:58.346226 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:58.346493 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:58.346496 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:58.346519 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:58.346693 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:58.346699 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.347735 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.347739 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:58.349202 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:58.349215 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.350113 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.350117 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:58.350292 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.350355 (+ 63us) client_negotiation.cc:769] Sending connection context
0812 02:42:58.350440 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 02:42:58.350554 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":287,"spinlock_wait_cycles":768}
I20260812 02:42:58.351505 23653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "130242cb52be444490e43c08b0f59b57" candidate_uuid: "20594d0fcd92491f82ad39004fd7894f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcbf2fd16e943468048d0905f706883" is_pre_election: true
I20260812 02:42:58.351559 24217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "130242cb52be444490e43c08b0f59b57" candidate_uuid: "20594d0fcd92491f82ad39004fd7894f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5c8fc0597e46b4843cefda11b516bd" is_pre_election: true
I20260812 02:42:58.351835 24217 raft_consensus.cc:2454] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20594d0fcd92491f82ad39004fd7894f in term 0.
I20260812 02:42:58.351858 23653 raft_consensus.cc:2454] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20594d0fcd92491f82ad39004fd7894f in term 0.
I20260812 02:42:58.352324 23807 leader_election.cc:302] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20594d0fcd92491f82ad39004fd7894f, edcbf2fd16e943468048d0905f706883; no voters:
I20260812 02:42:58.352716 24373 raft_consensus.cc:2781] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:42:58.352805 24373 raft_consensus.cc:482] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:42:58.352902 24373 raft_consensus.cc:3037] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:58.354104 24373 raft_consensus.cc:504] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } } peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } }
I20260812 02:42:58.354416 24373 leader_election.cc:288] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [CANDIDATE]: Term 1 election: Requested vote from peers edcbf2fd16e943468048d0905f706883 (127.10.75.65:46729), 9f5c8fc0597e46b4843cefda11b516bd (127.10.75.67:42971)
I20260812 02:42:58.354820 24217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "130242cb52be444490e43c08b0f59b57" candidate_uuid: "20594d0fcd92491f82ad39004fd7894f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5c8fc0597e46b4843cefda11b516bd"
I20260812 02:42:58.354820 23653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "130242cb52be444490e43c08b0f59b57" candidate_uuid: "20594d0fcd92491f82ad39004fd7894f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcbf2fd16e943468048d0905f706883"
I20260812 02:42:58.354943 24217 raft_consensus.cc:3037] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:58.354944 23653 raft_consensus.cc:3037] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:42:58.356243 24217 raft_consensus.cc:2454] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20594d0fcd92491f82ad39004fd7894f in term 1.
I20260812 02:42:58.356243 23653 raft_consensus.cc:2454] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20594d0fcd92491f82ad39004fd7894f in term 1.
I20260812 02:42:58.356554 23805 leader_election.cc:302] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20594d0fcd92491f82ad39004fd7894f, 9f5c8fc0597e46b4843cefda11b516bd; no voters:
I20260812 02:42:58.356737 24373 raft_consensus.cc:2781] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:42:58.356909 24373 raft_consensus.cc:686] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [term 1 LEADER]: Becoming Leader. State: Replica: 20594d0fcd92491f82ad39004fd7894f, State: Running, Role: LEADER
I20260812 02:42:58.357245 24373 consensus_queue.cc:237] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } } peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } }
I20260812 02:42:58.360937 21912 catalog_manager.cc:5495] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f reported cstate change: term changed from 0 to 1, leader changed from <none> to 20594d0fcd92491f82ad39004fd7894f (127.10.75.66). New cstate: current_term: 1 leader_uuid: "20594d0fcd92491f82ad39004fd7894f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } health_report { overall_health: UNKNOWN } } }
W20260812 02:42:58.372447 24301 tablet.cc:2369] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 02:42:58.393411 24060 tablet.cc:2369] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:42:58.415076 24355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.411537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50790 (local address 127.10.75.66:43595)
0812 02:42:58.411679 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:58.411683 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:58.411786 (+ 103us) server_negotiation.cc:407] Connection header received
0812 02:42:58.411916 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:58.411918 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:58.411972 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:58.412062 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:42:58.412293 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.412810 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.413707 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.413904 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.413979 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.414371 (+ 392us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:42:58.414758 (+ 387us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:42:58.414846 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:58.414912 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 02:42:58.414958 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 02:42:58.421061 24217 raft_consensus.cc:1261] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd [term 1 FOLLOWER]: Refusing update from remote peer 20594d0fcd92491f82ad39004fd7894f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:42:58.421063 23653 raft_consensus.cc:1261] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883 [term 1 FOLLOWER]: Refusing update from remote peer 20594d0fcd92491f82ad39004fd7894f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:42:58.421835 24373 consensus_queue.cc:1035] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:42:58.422077 24378 consensus_queue.cc:1035] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 02:42:58.428545 23758 tablet.cc:2369] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:42:58.430783 24383 mvcc.cc:205] Tried to move back new op lower bound from 7317514561205653504 to 7317514560953651200. Current Snapshot: MvccSnapshot[applied={T|T < 7317514561205653504 or (T in {7317514561205653504})}]
I20260812 02:42:58.433358 24384 mvcc.cc:205] Tried to move back new op lower bound from 7317514561205653504 to 7317514560953651200. Current Snapshot: MvccSnapshot[applied={T|T < 7317514561205653504}]
I20260812 02:42:58.437834 24385 mvcc.cc:205] Tried to move back new op lower bound from 7317514561205653504 to 7317514560953651200. Current Snapshot: MvccSnapshot[applied={T|T < 7317514561205653504}]
I20260812 02:42:58.438540 21907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:42:58.438707 21907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:42:58.443711 21907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c62d7bb434ff489f9f7fa8e977d85c14: Sending DeleteTablet for 3 replicas of tablet 130242cb52be444490e43c08b0f59b57
I20260812 02:42:58.444350 23623 tablet_service.cc:1514] Processing DeleteTablet for tablet 130242cb52be444490e43c08b0f59b57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:58 UTC) from {username='oryx', principal='oryx/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:54092
I20260812 02:42:58.444557 23913 tablet_service.cc:1514] Processing DeleteTablet for tablet 130242cb52be444490e43c08b0f59b57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:58 UTC) from {username='oryx', principal='oryx/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:50778
I20260812 02:42:58.444752 24182 tablet_service.cc:1514] Processing DeleteTablet for tablet 130242cb52be444490e43c08b0f59b57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:42:58 UTC) from {username='oryx', principal='oryx/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:42850
I20260812 02:42:58.445179 24397 tablet_replica.cc:330] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd: stopping tablet replica
I20260812 02:42:58.445358 24396 tablet_replica.cc:330] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f: stopping tablet replica
I20260812 02:42:58.445637 24397 raft_consensus.cc:2229] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:42:58.445983 24397 raft_consensus.cc:2258] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:58.446957 24395 tablet_replica.cc:330] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883: stopping tablet replica
I20260812 02:42:58.447238 24395 raft_consensus.cc:2229] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:42:58.447495 24395 raft_consensus.cc:2258] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:58.447832 24396 raft_consensus.cc:2229] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:42:58.447934 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 21847
I20260812 02:42:58.459815 24397 ts_tablet_manager.cc:1905] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:58.460063 24396 raft_consensus.cc:2258] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:42:58.462949 24396 ts_tablet_manager.cc:1905] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:58.463129 24397 ts_tablet_manager.cc:1918] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:42:58.463272 24397 log.cc:1196] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/130242cb52be444490e43c08b0f59b57
I20260812 02:42:58.463707 24397 ts_tablet_manager.cc:1939] T 130242cb52be444490e43c08b0f59b57 P 9f5c8fc0597e46b4843cefda11b516bd: Deleting consensus metadata
I20260812 02:42:58.466480 24396 ts_tablet_manager.cc:1918] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:42:58.466581 24396 log.cc:1196] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/130242cb52be444490e43c08b0f59b57
I20260812 02:42:58.466919 24396 ts_tablet_manager.cc:1939] T 130242cb52be444490e43c08b0f59b57 P 20594d0fcd92491f82ad39004fd7894f: Deleting consensus metadata
W20260812 02:42:58.470995 24097 connection.cc:535] server connection from 127.0.0.1:42850 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 02:42:58.472110 23809 connection.cc:535] server connection from 127.0.0.1:50778 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 02:42:58.472182 24395 ts_tablet_manager.cc:1905] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:42:58.475158 24395 ts_tablet_manager.cc:1918] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:42:58.475262 24395 log.cc:1196] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-0/wal/wals/130242cb52be444490e43c08b0f59b57
I20260812 02:42:58.475627 24395 ts_tablet_manager.cc:1939] T 130242cb52be444490e43c08b0f59b57 P edcbf2fd16e943468048d0905f706883: Deleting consensus metadata
W20260812 02:42:58.478307 23551 connection.cc:441] server connection from 127.0.0.1:54092 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54092 (request call id 1) could send its response
I20260812 02:42:58.481480 24323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.446773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44092 (local address 127.10.75.125:46667)
0812 02:42:58.446884 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:58.446888 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:58.468269 (+ 21381us) server_negotiation.cc:407] Connection header received
0812 02:42:58.468488 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:58.468494 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:58.468559 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:58.468616 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:58.469854 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.470758 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.471993 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.472322 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.472429 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.477810 (+ 5381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:58.477814 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:58.477816 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:58.477842 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:58.479675 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.480168 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.480172 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.480174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.480266 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.480578 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.480584 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.480587 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.480774 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:58.480921 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:58.481172 (+ 251us) server_negotiation.cc:299] Negotiation successful
0812 02:42:58.481298 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 02:42:58.486209 23312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.476196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44100 (local address 127.10.75.125:46667)
0812 02:42:58.476332 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:58.476338 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:58.476868 (+ 530us) server_negotiation.cc:407] Connection header received
0812 02:42:58.477068 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:58.477072 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:58.477135 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:58.477233 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:58.478010 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.478822 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.480045 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.480334 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.480441 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.482879 (+ 2438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:58.482886 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:58.482891 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:58.482922 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:58.484338 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.484843 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.484847 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.484849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.484932 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.485207 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.485210 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.485212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.485406 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:58.485542 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:58.485794 (+ 252us) server_negotiation.cc:299] Negotiation successful
0812 02:42:58.485906 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 02:42:58.490733 24331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.446621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53980 (local address 127.10.75.124:42665)
0812 02:42:58.446747 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:58.446753 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:58.482024 (+ 35271us) server_negotiation.cc:407] Connection header received
0812 02:42:58.482102 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:58.482105 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:58.482164 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:58.482256 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:58.482987 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.483788 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.485117 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.485467 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.485568 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.487445 (+ 1877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:58.487448 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:58.487455 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:58.487478 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:58.489036 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.489454 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.489458 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.489460 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.489538 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.489822 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.489826 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.489827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.489997 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:58.490157 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:58.490404 (+ 247us) server_negotiation.cc:299] Negotiation successful
0812 02:42:58.490532 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 02:42:58.494920 23760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:58.476684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53982 (local address 127.10.75.124:42665)
0812 02:42:58.476825 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:58.476829 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:58.486216 (+ 9387us) server_negotiation.cc:407] Connection header received
0812 02:42:58.486782 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:58.486785 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:58.486827 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:58.486874 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:42:58.487674 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.488427 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.489567 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:58.489903 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:58.489972 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:58.491769 (+ 1797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:42:58.491772 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:42:58.491774 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:42:58.491794 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:42:58.493332 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.493797 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.493800 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.493802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.493884 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:42:58.494214 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:42:58.494216 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:42:58.494217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:42:58.494367 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:42:58.494465 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:58.494737 (+ 272us) server_negotiation.cc:299] Negotiation successful
0812 02:42:58.494823 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 02:42:59.437721 24414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:59.437199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.67:51685)
0812 02:42:59.437470 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:59.437596 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":108,"threads_started":1}
W20260812 02:42:59.438030 24299 heartbeater.cc:644] Failed to heartbeat to 127.10.75.126:34761 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
I20260812 02:42:59.440009 24415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:59.439650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.66:42791)
0812 02:42:59.439854 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:59.439922 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":63,"threads_started":1}
W20260812 02:42:59.440272 24055 heartbeater.cc:644] Failed to heartbeat to 127.10.75.126:34761 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
I20260812 02:42:59.445979 24416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:59.445576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.65:39725)
0812 02:42:59.445824 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:59.445901 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":76,"threads_started":1}
W20260812 02:42:59.446307 23753 heartbeater.cc:644] Failed to heartbeat to 127.10.75.126:34761 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
I20260812 02:42:59.944013 24417 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c62d7bb434ff489f9f7fa8e977d85c14)
I20260812 02:42:59.944319 24417 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: false } }
I20260812 02:42:59.945400 24417 leader_election.cc:288] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c62d7bb434ff489f9f7fa8e977d85c14 (127.10.75.126:34761), 9be2ee0c5ec74360804306d6aad865cd (127.10.75.125:46667)
I20260812 02:42:59.946197 24420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:59.945602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.0.0.1:60198)
0812 02:42:59.945924 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:59.946026 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":64,"threads_started":1}
I20260812 02:42:59.946297 24423 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c62d7bb434ff489f9f7fa8e977d85c14)
W20260812 02:42:59.946491 23396 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
I20260812 02:42:59.946491 24423 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: false } }
I20260812 02:42:59.947396 24420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:59.947139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.0.0.1:60206)
0812 02:42:59.947256 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:59.947313 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 02:42:59.947841 24423 leader_election.cc:288] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c62d7bb434ff489f9f7fa8e977d85c14 (127.10.75.126:34761), 7cc75143287a482897caab3513bd73e9 (127.10.75.124:42665)
W20260812 02:42:59.948683 23396 leader_election.cc:334] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c62d7bb434ff489f9f7fa8e977d85c14 (127.10.75.126:34761): Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
I20260812 02:42:59.948963 24428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:59.947553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.0.0.1:60220)
0812 02:42:59.947776 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:59.947846 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":74,"threads_started":1}
W20260812 02:42:59.949131 23064 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
I20260812 02:42:59.950100 24428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:59.949812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.0.0.1:60234)
0812 02:42:59.949945 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:59.950003 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 02:42:59.950331 23064 leader_election.cc:334] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c62d7bb434ff489f9f7fa8e977d85c14 (127.10.75.126:34761): Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
I20260812 02:42:59.950557 24418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:59.945644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:46667 (local address 127.0.0.1:44110)
0812 02:42:59.945949 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:59.945965 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:59.946097 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:59.946567 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:59.946570 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:59.946595 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:59.946816 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:59.946824 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:59.947977 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:59.947981 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:59.949134 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:59.949148 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:59.950093 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:59.950097 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:59.950192 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:59.950216 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 02:42:59.950339 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 02:42:59.950422 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":69,"threads_started":1}
I20260812 02:42:59.950618 24421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:59.945758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44110 (local address 127.10.75.125:46667)
0812 02:42:59.946094 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:59.946099 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:59.946116 (+ 17us) server_negotiation.cc:407] Connection header received
0812 02:42:59.946204 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:59.946207 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:59.946419 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:59.946520 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:59.947005 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:59.947844 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:59.949242 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:59.949938 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:59.950097 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:59.950160 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:59.950358 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 02:42:59.950492 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":70,"threads_started":1}
I20260812 02:42:59.951045 23114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7cc75143287a482897caab3513bd73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "9be2ee0c5ec74360804306d6aad865cd" is_pre_election: true
I20260812 02:42:59.951220 23114 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cc75143287a482897caab3513bd73e9 in term 1.
I20260812 02:42:59.951629 23395 leader_election.cc:302] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7cc75143287a482897caab3513bd73e9, 9be2ee0c5ec74360804306d6aad865cd; no voters: c62d7bb434ff489f9f7fa8e977d85c14
I20260812 02:42:59.951841 24417 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 02:42:59.951895 24417 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c62d7bb434ff489f9f7fa8e977d85c14)
I20260812 02:42:59.951933 24417 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 1 FOLLOWER]: Advancing to term 2
I20260812 02:42:59.952877 24429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:59.948249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:42665 (local address 127.0.0.1:53988)
0812 02:42:59.948967 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:59.948983 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:42:59.949204 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:42:59.949675 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:42:59.949679 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:42:59.949701 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:42:59.949811 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:59.949817 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:59.950864 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:59.950868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:59.951764 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:42:59.951776 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:42:59.952461 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:42:59.952464 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:42:59.952569 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:59.952588 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 02:42:59.952680 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 02:42:59.952757 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":70,"threads_started":1}
I20260812 02:42:59.952876 24430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:59.948482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53988 (local address 127.10.75.124:42665)
0812 02:42:59.948896 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0812 02:42:59.948906 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 02:42:59.949134 (+ 228us) server_negotiation.cc:407] Connection header received
0812 02:42:59.949401 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:42:59.949404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:42:59.949447 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:42:59.949570 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:42:59.949987 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:59.950727 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:59.951907 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:42:59.952325 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:42:59.952448 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:42:59.952501 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 02:42:59.952698 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 02:42:59.952766 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":111,"threads_started":1}
I20260812 02:42:59.952937 24417 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: false } }
I20260812 02:42:59.953388 24417 leader_election.cc:288] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [CANDIDATE]: Term 2 election: Requested vote from peers c62d7bb434ff489f9f7fa8e977d85c14 (127.10.75.126:34761), 9be2ee0c5ec74360804306d6aad865cd (127.10.75.125:46667)
I20260812 02:42:59.953431 23444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9be2ee0c5ec74360804306d6aad865cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7cc75143287a482897caab3513bd73e9" is_pre_election: true
I20260812 02:42:59.953711 23444 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9be2ee0c5ec74360804306d6aad865cd in current term 2: Already voted for candidate 7cc75143287a482897caab3513bd73e9 in this term.
I20260812 02:42:59.953794 23114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7cc75143287a482897caab3513bd73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "9be2ee0c5ec74360804306d6aad865cd"
I20260812 02:42:59.953843 24418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:59.953483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.0.0.1:60240)
0812 02:42:59.953730 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:59.953780 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188}
I20260812 02:42:59.953949 23114 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 1 FOLLOWER]: Advancing to term 2
I20260812 02:42:59.954535 24418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:42:59.954346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.0.0.1:60244)
0812 02:42:59.954427 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0812 02:42:59.954476 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260812 02:42:59.954639 23396 leader_election.cc:334] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c62d7bb434ff489f9f7fa8e977d85c14 (127.10.75.126:34761): Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
I20260812 02:42:59.955188 23114 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cc75143287a482897caab3513bd73e9 in term 2.
I20260812 02:42:59.955514 23395 leader_election.cc:302] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7cc75143287a482897caab3513bd73e9, 9be2ee0c5ec74360804306d6aad865cd; no voters: c62d7bb434ff489f9f7fa8e977d85c14
I20260812 02:42:59.955638 23063 leader_election.cc:302] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9be2ee0c5ec74360804306d6aad865cd; no voters: 7cc75143287a482897caab3513bd73e9, c62d7bb434ff489f9f7fa8e977d85c14
I20260812 02:42:59.955680 24417 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 02:42:59.955873 24423 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 02:42:59.955884 24417 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [term 2 LEADER]: Becoming Leader. State: Replica: 7cc75143287a482897caab3513bd73e9, State: Running, Role: LEADER
I20260812 02:42:59.956116 24417 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: false } }
I20260812 02:42:59.957494 24433 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7cc75143287a482897caab3513bd73e9. Latest consensus state: current_term: 2 leader_uuid: "7cc75143287a482897caab3513bd73e9" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: false } } }
I20260812 02:42:59.957628 24433 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [sys.catalog]: This master's current role is: LEADER
I20260812 02:42:59.957965 24435 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:42:59.960397 24435 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:42:59.960800 24435 catalog_manager.cc:1259] Loaded cluster ID: aa7a20c8e90a4c46a42e4879721e8d83
I20260812 02:42:59.960846 24435 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:42:59.961380 24435 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:42:59.961777 24435 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: Loaded TSK: 0
I20260812 02:42:59.962473 24435 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:43:00.006260 23426 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53982:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:43:00.009428 23426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:43:00.012446 24418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.012205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.0.0.1:60274)
0812 02:43:00.012328 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:00.012382 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 02:43:00.012533 23114 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [term 2 FOLLOWER]: Refusing update from remote peer 7cc75143287a482897caab3513bd73e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260812 02:43:00.013132 24418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.012911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.0.0.1:60290)
0812 02:43:00.013019 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:00.013068 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 02:43:00.013096 24433 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260812 02:43:00.013262 23396 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 -> Peer c62d7bb434ff489f9f7fa8e977d85c14 (127.10.75.126:34761): Couldn't send request to peer c62d7bb434ff489f9f7fa8e977d85c14. Status: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 02:43:00.014649 24423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7cc75143287a482897caab3513bd73e9. Latest consensus state: current_term: 2 leader_uuid: "7cc75143287a482897caab3513bd73e9" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: false } } }
I20260812 02:43:00.014787 24423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:43:00.015874 24417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "7cc75143287a482897caab3513bd73e9" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: false } } }
I20260812 02:43:00.015997 24417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9 [sys.catalog]: This master's current role is: LEADER
I20260812 02:43:00.016213 24423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "7cc75143287a482897caab3513bd73e9" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c62d7bb434ff489f9f7fa8e977d85c14" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34761 } } peers { permanent_uuid: "9be2ee0c5ec74360804306d6aad865cd" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 46667 } attrs { promote: false } } peers { permanent_uuid: "7cc75143287a482897caab3513bd73e9" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 42665 } attrs { promote: false } } }
I20260812 02:43:00.016336 24423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9be2ee0c5ec74360804306d6aad865cd [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:43:00.026989 24418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.022037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:43595 (local address 127.0.0.1:50802)
0812 02:43:00.022217 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:00.022232 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:00.022311 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:00.023190 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:00.023192 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:00.023206 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:43:00.023288 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:00.023292 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:00.024356 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:00.024359 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:00.025538 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:00.025558 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:00.026518 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:00.026521 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:00.026601 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:00.026688 (+ 87us) client_negotiation.cc:769] Sending connection context
0812 02:43:00.026772 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 02:43:00.026862 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":30}
I20260812 02:43:00.027094 24451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.022761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42856 (local address 127.10.75.67:42971)
0812 02:43:00.023394 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:00.023400 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:00.023414 (+ 14us) server_negotiation.cc:407] Connection header received
0812 02:43:00.023461 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:00.023464 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:00.023508 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:00.023597 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:43:00.023869 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:00.024547 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:00.025570 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:00.026215 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:00.026318 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:00.026406 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:00.026884 (+ 478us) server_negotiation.cc:299] Negotiation successful
0812 02:43:00.026956 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":80,"threads_started":1}
I20260812 02:43:00.027354 24450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.022664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:42971 (local address 127.0.0.1:42856)
0812 02:43:00.022919 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:00.022932 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:00.023020 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:00.023623 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:00.023626 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:00.023648 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:43:00.023751 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:00.023757 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:00.024668 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:00.024673 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:00.025431 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:00.025440 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:00.026468 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:00.026472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:00.026638 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:00.026690 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 02:43:00.026764 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 02:43:00.027230 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":406,"thread_start_us":106,"threads_started":1}
I20260812 02:43:00.027508 24448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.022191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50802 (local address 127.10.75.66:43595)
0812 02:43:00.022937 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:00.022944 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:00.022961 (+ 17us) server_negotiation.cc:407] Connection header received
0812 02:43:00.023016 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:00.023022 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:00.023083 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:00.023169 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:43:00.023426 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:00.024232 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:00.025654 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:00.026319 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:00.026405 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:00.026470 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:00.027272 (+ 802us) server_negotiation.cc:299] Negotiation successful
0812 02:43:00.027353 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":89,"threads_started":1}
I20260812 02:43:00.027597 24420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.022641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:46729 (local address 127.0.0.1:54098)
0812 02:43:00.022892 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:00.022907 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:00.022994 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:00.023737 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:00.023740 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:00.023754 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:43:00.023841 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:00.023848 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:00.024851 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:00.024855 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:00.025953 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:00.025961 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:00.027203 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:00.027210 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:00.027297 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:00.027322 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 02:43:00.027371 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 02:43:00.027448 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182}
I20260812 02:43:00.028074 24182 tablet_service.cc:1467] Processing CreateTablet for tablet 9a230032687143aab9b5728d8700d840 (DEFAULT_TABLE table=test-table [id=c55ff4f1b55146a5bfda92d69518ede5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:43:00.028118 24454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.023177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54098 (local address 127.10.75.65:46729)
0812 02:43:00.023475 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:00.023485 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:00.023496 (+ 11us) server_negotiation.cc:407] Connection header received
0812 02:43:00.023541 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:00.023543 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:00.023612 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:00.023945 (+ 333us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:43:00.024040 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:00.024712 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:00.026366 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:00.027017 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:00.027793 (+ 776us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:00.027864 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:00.027908 (+ 44us) server_negotiation.cc:299] Negotiation successful
0812 02:43:00.027984 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":104,"threads_started":1}
I20260812 02:43:00.028123 23913 tablet_service.cc:1467] Processing CreateTablet for tablet 9a230032687143aab9b5728d8700d840 (DEFAULT_TABLE table=test-table [id=c55ff4f1b55146a5bfda92d69518ede5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:43:00.028410 23913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a230032687143aab9b5728d8700d840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:00.028414 24182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a230032687143aab9b5728d8700d840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:00.028676 23623 tablet_service.cc:1467] Processing CreateTablet for tablet 9a230032687143aab9b5728d8700d840 (DEFAULT_TABLE table=test-table [id=c55ff4f1b55146a5bfda92d69518ede5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:43:00.028970 23623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a230032687143aab9b5728d8700d840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:00.030910 24455 tablet_bootstrap.cc:492] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f: Bootstrap starting.
I20260812 02:43:00.031646 24460 tablet_bootstrap.cc:492] T 9a230032687143aab9b5728d8700d840 P edcbf2fd16e943468048d0905f706883: Bootstrap starting.
I20260812 02:43:00.031991 24455 tablet_bootstrap.cc:654] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:00.032023 24458 tablet_bootstrap.cc:492] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd: Bootstrap starting.
I20260812 02:43:00.032648 24460 tablet_bootstrap.cc:654] T 9a230032687143aab9b5728d8700d840 P edcbf2fd16e943468048d0905f706883: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:00.032974 24458 tablet_bootstrap.cc:654] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:00.033360 24455 tablet_bootstrap.cc:492] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f: No bootstrap required, opened a new log
I20260812 02:43:00.033476 24455 ts_tablet_manager.cc:1397] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 02:43:00.033919 24460 tablet_bootstrap.cc:492] T 9a230032687143aab9b5728d8700d840 P edcbf2fd16e943468048d0905f706883: No bootstrap required, opened a new log
I20260812 02:43:00.033946 24455 raft_consensus.cc:348] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } } peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } }
I20260812 02:43:00.034022 24460 ts_tablet_manager.cc:1397] T 9a230032687143aab9b5728d8700d840 P edcbf2fd16e943468048d0905f706883: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 02:43:00.034091 24455 raft_consensus.cc:374] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:00.034137 24455 raft_consensus.cc:729] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20594d0fcd92491f82ad39004fd7894f, State: Initialized, Role: FOLLOWER
I20260812 02:43:00.034245 24458 tablet_bootstrap.cc:492] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd: No bootstrap required, opened a new log
I20260812 02:43:00.034283 24455 consensus_queue.cc:260] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } } peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } }
I20260812 02:43:00.034339 24458 ts_tablet_manager.cc:1397] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 02:43:00.034523 24460 raft_consensus.cc:348] T 9a230032687143aab9b5728d8700d840 P edcbf2fd16e943468048d0905f706883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } } peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } }
I20260812 02:43:00.034648 24460 raft_consensus.cc:374] T 9a230032687143aab9b5728d8700d840 P edcbf2fd16e943468048d0905f706883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:00.034683 24460 raft_consensus.cc:729] T 9a230032687143aab9b5728d8700d840 P edcbf2fd16e943468048d0905f706883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcbf2fd16e943468048d0905f706883, State: Initialized, Role: FOLLOWER
I20260812 02:43:00.034770 24458 raft_consensus.cc:348] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } } peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } }
I20260812 02:43:00.034888 24458 raft_consensus.cc:374] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:00.034924 24458 raft_consensus.cc:729] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5c8fc0597e46b4843cefda11b516bd, State: Initialized, Role: FOLLOWER
I20260812 02:43:00.035090 24455 ts_tablet_manager.cc:1428] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 02:43:00.035061 24458 consensus_queue.cc:260] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } } peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } }
I20260812 02:43:00.035430 24458 ts_tablet_manager.cc:1428] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 02:43:00.036598 24473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.036145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.67:48231)
0812 02:43:00.036392 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:00.036457 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":112,"threads_started":1}
I20260812 02:43:00.037236 24053 heartbeater.cc:503] Master 127.10.75.124:42665 was elected leader, sending a full tablet report...
I20260812 02:43:00.037724 24460 consensus_queue.cc:260] T 9a230032687143aab9b5728d8700d840 P edcbf2fd16e943468048d0905f706883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } } peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } }
I20260812 02:43:00.038165 24460 ts_tablet_manager.cc:1428] T 9a230032687143aab9b5728d8700d840 P edcbf2fd16e943468048d0905f706883: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260812 02:43:00.039166 24471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.034933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.66:34405)
0812 02:43:00.038991 (+ 4058us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:00.039067 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3990,"thread_start_us":110,"threads_started":1}
I20260812 02:43:00.039556 24478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.038633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.65:49693)
0812 02:43:00.039102 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:00.039173 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":106,"threads_started":1}
I20260812 02:43:00.039861 23750 heartbeater.cc:503] Master 127.10.75.124:42665 was elected leader, sending a full tablet report...
I20260812 02:43:00.040057 24471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.039579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.66:47557)
0812 02:43:00.039876 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:00.039965 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":106,"threads_started":1}
I20260812 02:43:00.040432 24478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.040166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.65:33619)
0812 02:43:00.040314 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:00.040365 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260812 02:43:00.040431 24297 heartbeater.cc:503] Master 127.10.75.124:42665 was elected leader, sending a full tablet report...
I20260812 02:43:00.041751 24473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.041432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.67:50673)
0812 02:43:00.041624 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:00.041681 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 02:43:00.048544 24467 raft_consensus.cc:482] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:43:00.048640 24467 raft_consensus.cc:504] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } } peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } }
I20260812 02:43:00.049100 24467 leader_election.cc:288] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edcbf2fd16e943468048d0905f706883 (127.10.75.65:46729), 9f5c8fc0597e46b4843cefda11b516bd (127.10.75.67:42971)
I20260812 02:43:00.049376 23653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a230032687143aab9b5728d8700d840" candidate_uuid: "20594d0fcd92491f82ad39004fd7894f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcbf2fd16e943468048d0905f706883" is_pre_election: true
I20260812 02:43:00.049508 23653 raft_consensus.cc:2454] T 9a230032687143aab9b5728d8700d840 P edcbf2fd16e943468048d0905f706883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20594d0fcd92491f82ad39004fd7894f in term 0.
I20260812 02:43:00.049521 24217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a230032687143aab9b5728d8700d840" candidate_uuid: "20594d0fcd92491f82ad39004fd7894f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5c8fc0597e46b4843cefda11b516bd" is_pre_election: true
I20260812 02:43:00.049702 24217 raft_consensus.cc:2454] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20594d0fcd92491f82ad39004fd7894f in term 0.
I20260812 02:43:00.050002 23805 leader_election.cc:302] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20594d0fcd92491f82ad39004fd7894f, 9f5c8fc0597e46b4843cefda11b516bd; no voters:
I20260812 02:43:00.050246 24467 raft_consensus.cc:2781] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:43:00.050314 24467 raft_consensus.cc:482] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:43:00.050341 24467 raft_consensus.cc:3037] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:00.051259 24467 raft_consensus.cc:504] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } } peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } }
I20260812 02:43:00.051580 24467 leader_election.cc:288] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [CANDIDATE]: Term 1 election: Requested vote from peers edcbf2fd16e943468048d0905f706883 (127.10.75.65:46729), 9f5c8fc0597e46b4843cefda11b516bd (127.10.75.67:42971)
I20260812 02:43:00.051867 23653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a230032687143aab9b5728d8700d840" candidate_uuid: "20594d0fcd92491f82ad39004fd7894f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcbf2fd16e943468048d0905f706883"
I20260812 02:43:00.051990 23653 raft_consensus.cc:3037] T 9a230032687143aab9b5728d8700d840 P edcbf2fd16e943468048d0905f706883 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:00.051975 24217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a230032687143aab9b5728d8700d840" candidate_uuid: "20594d0fcd92491f82ad39004fd7894f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5c8fc0597e46b4843cefda11b516bd"
I20260812 02:43:00.052073 24217 raft_consensus.cc:3037] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:00.053105 23653 raft_consensus.cc:2454] T 9a230032687143aab9b5728d8700d840 P edcbf2fd16e943468048d0905f706883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20594d0fcd92491f82ad39004fd7894f in term 1.
I20260812 02:43:00.053105 24217 raft_consensus.cc:2454] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20594d0fcd92491f82ad39004fd7894f in term 1.
I20260812 02:43:00.053400 23805 leader_election.cc:302] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20594d0fcd92491f82ad39004fd7894f, 9f5c8fc0597e46b4843cefda11b516bd; no voters:
I20260812 02:43:00.053607 24467 raft_consensus.cc:2781] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:43:00.053812 24467 raft_consensus.cc:686] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [term 1 LEADER]: Becoming Leader. State: Replica: 20594d0fcd92491f82ad39004fd7894f, State: Running, Role: LEADER
I20260812 02:43:00.053967 24467 consensus_queue.cc:237] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } } peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } }
I20260812 02:43:00.054490 24479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.054259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.66:41523)
0812 02:43:00.054355 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:00.054413 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 02:43:00.055605 23425 catalog_manager.cc:5495] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f reported cstate change: term changed from 0 to 1, leader changed from <none> to 20594d0fcd92491f82ad39004fd7894f (127.10.75.66). New cstate: current_term: 1 leader_uuid: "20594d0fcd92491f82ad39004fd7894f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20594d0fcd92491f82ad39004fd7894f" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 43595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 } health_report { overall_health: UNKNOWN } } }
I20260812 02:43:00.069585 24448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.066760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50804 (local address 127.10.75.66:43595)
0812 02:43:00.066891 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:00.066895 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:00.066908 (+ 13us) server_negotiation.cc:407] Connection header received
0812 02:43:00.066991 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:00.066993 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:00.067033 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:00.067096 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:43:00.067389 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:00.067899 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:00.068708 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:00.068909 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:00.068984 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:00.069199 (+ 215us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:43:00.069262 (+ 63us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:43:00.069314 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:00.069431 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 02:43:00.069479 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 02:43:00.071914 24217 raft_consensus.cc:1261] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd [term 1 FOLLOWER]: Refusing update from remote peer 20594d0fcd92491f82ad39004fd7894f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:43:00.071938 23653 raft_consensus.cc:1261] T 9a230032687143aab9b5728d8700d840 P edcbf2fd16e943468048d0905f706883 [term 1 FOLLOWER]: Refusing update from remote peer 20594d0fcd92491f82ad39004fd7894f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:43:00.072402 24467 consensus_queue.cc:1035] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5c8fc0597e46b4843cefda11b516bd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:43:00.072595 24480 consensus_queue.cc:1035] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcbf2fd16e943468048d0905f706883" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:43:00.074368 24478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.074025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.65:41901)
0812 02:43:00.074220 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:00.074281 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124}
I20260812 02:43:00.077108 24479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.076880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.66:53487)
0812 02:43:00.076985 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:00.077040 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 02:43:00.078526 24473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.074746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.67:36425)
0812 02:43:00.077839 (+ 3093us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:00.077895 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3012}
I20260812 02:43:00.079015 24479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.078673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.66:47293)
0812 02:43:00.078928 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:00.078969 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202}
I20260812 02:43:00.079376 24501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.078920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.67:41283)
0812 02:43:00.079198 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:00.079263 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":104,"threads_started":1}
I20260812 02:43:00.081535 23431 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:43:00.081696 23431 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:43:00.082316 24478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.082021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34761 (local address 127.10.75.65:33633)
0812 02:43:00.082193 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:00.082250 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:34761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260812 02:43:00.086370 23431 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7cc75143287a482897caab3513bd73e9: Sending DeleteTablet for 3 replicas of tablet 9a230032687143aab9b5728d8700d840
I20260812 02:43:00.087007 23913 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a230032687143aab9b5728d8700d840 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:43:00 UTC) from {username='oryx', principal='oryx/127.10.75.124@KRBTEST.COM'} at 127.0.0.1:50802
I20260812 02:43:00.087060 24182 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a230032687143aab9b5728d8700d840 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:43:00 UTC) from {username='oryx', principal='oryx/127.10.75.124@KRBTEST.COM'} at 127.0.0.1:42856
I20260812 02:43:00.087276 23623 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a230032687143aab9b5728d8700d840 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:43:00 UTC) from {username='oryx', principal='oryx/127.10.75.124@KRBTEST.COM'} at 127.0.0.1:54098
I20260812 02:43:00.087345 24507 tablet_replica.cc:330] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f: stopping tablet replica
I20260812 02:43:00.087481 24507 raft_consensus.cc:2229] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:43:00.087651 24507 raft_consensus.cc:2258] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:43:00.087810 24511 tablet_replica.cc:330] T 9a230032687143aab9b5728d8700d840 P edcbf2fd16e943468048d0905f706883: stopping tablet replica
I20260812 02:43:00.087884 24506 tablet_replica.cc:330] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd: stopping tablet replica
I20260812 02:43:00.087932 24511 raft_consensus.cc:2229] T 9a230032687143aab9b5728d8700d840 P edcbf2fd16e943468048d0905f706883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:43:00.088018 24506 raft_consensus.cc:2229] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:43:00.088068 24511 raft_consensus.cc:2258] T 9a230032687143aab9b5728d8700d840 P edcbf2fd16e943468048d0905f706883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:43:00.088094 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 23355
I20260812 02:43:00.089187 24506 raft_consensus.cc:2258] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:43:00.089696 24507 ts_tablet_manager.cc:1905] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:43:00.092868 24506 ts_tablet_manager.cc:1905] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:43:00.092896 24507 ts_tablet_manager.cc:1918] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:43:00.092985 24507 log.cc:1196] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/9a230032687143aab9b5728d8700d840
I20260812 02:43:00.093325 24507 ts_tablet_manager.cc:1939] T 9a230032687143aab9b5728d8700d840 P 20594d0fcd92491f82ad39004fd7894f: Deleting consensus metadata
I20260812 02:43:00.094038 23394 catalog_manager.cc:4841] TS 20594d0fcd92491f82ad39004fd7894f (127.10.75.66:43595): tablet 9a230032687143aab9b5728d8700d840 (table test-table [id=c55ff4f1b55146a5bfda92d69518ede5]) successfully deleted
I20260812 02:43:00.095072 24506 ts_tablet_manager.cc:1918] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:43:00.095124 24506 log.cc:1196] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/9a230032687143aab9b5728d8700d840
I20260812 02:43:00.095304 24506 ts_tablet_manager.cc:1939] T 9a230032687143aab9b5728d8700d840 P 9f5c8fc0597e46b4843cefda11b516bd: Deleting consensus metadata
I20260812 02:43:00.096107 23394 catalog_manager.cc:4841] TS 9f5c8fc0597e46b4843cefda11b516bd (127.10.75.67:42971): tablet 9a230032687143aab9b5728d8700d840 (table test-table [id=c55ff4f1b55146a5bfda92d69518ede5]) successfully deleted
I20260812 02:43:00.105876 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 23772
I20260812 02:43:00.106289 24450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:00.105898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:46729 (local address 127.0.0.1:54102)
0812 02:43:00.106132 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:00.106193 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.65:46729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260812 02:43:00.112031 23395 catalog_manager.cc:4584] TS edcbf2fd16e943468048d0905f706883 (127.10.75.65:46729): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9a230032687143aab9b5728d8700d840: Network error: Client connection negotiation failed: client connection to 127.10.75.65:46729: connect: Connection refused (error 111)
I20260812 02:43:00.122164 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 24066
I20260812 02:43:00.144469 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 22813
I20260812 02:43:00.156137 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 23021
2026-08-12T02:43:00Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5800 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:43:00 dist-test-slave-2p8l krb5kdc[24514](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:43:00 dist-test-slave-2p8l krb5kdc[24514](info): set up 2 sockets
Aug 12 02:43:00 dist-test-slave-2p8l krb5kdc[24514](info): commencing operation
krb5kdc: starting...
W20260812 02:43:01.480433 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.291s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:43:01 dist-test-slave-2p8l krb5kdc[24514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:43:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:43:01Z Disabled control of system clock
WARNING: no policy specified for oryx/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.126.keytab.
Entry for principal oryx/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.126.keytab.
I20260812 02:43:01.609205 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:38387
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.126.keytab
--principal=oryx/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:33001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:38387
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:43:01.723626 24539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:01.723920 24539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:01.723991 24539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:01.728119 24539 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:43:01.728207 24539 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 02:43:01.728241 24539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:01.728283 24539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:01.728317 24539 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:43:01.728348 24539 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:43:01.733639 24539 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:33001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:38387
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.126.keytab
--principal=oryx/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:38387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:01.734722 24539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:01.735742 24539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:01.744204 24554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:01.744220 24548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:01.744539 24539 server_base.cc:1034] running on GCE node
W20260812 02:43:01.744242 24552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:01.745119 24539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:01.746237 24539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:01.747434 24539 hybrid_clock.cc:648] HybridClock initialized: now 1786502581747417 us; error 30 us; skew 500 ppm
Aug 12 02:43:01 dist-test-slave-2p8l krb5kdc[24514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502581, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:43:01.750326 24539 init.cc:377] Logged in from keytab as oryx/127.10.75.126@KRBTEST.COM (short username oryx)
I20260812 02:43:01.751240 24539 webserver.cc:460] Webserver started at http://127.10.75.126:39895/ using document root <none> and password file <none>
I20260812 02:43:01.751847 24539 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:01.751945 24539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:01.752200 24539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:01.754328 24539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "d64368a582174781bc2cb9ae932c96f0"
format_stamp: "Formatted at 2026-08-12 02:43:01 on dist-test-slave-2p8l"
server_key: "a78f2b14b218937ebdf6c65a00887a11"
server_key_iv: "e4a2d58515294c3d6fa6402f2f501d75"
server_key_version: "encryptionkey@0"
I20260812 02:43:01.754904 24539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "d64368a582174781bc2cb9ae932c96f0"
format_stamp: "Formatted at 2026-08-12 02:43:01 on dist-test-slave-2p8l"
server_key: "a78f2b14b218937ebdf6c65a00887a11"
server_key_iv: "e4a2d58515294c3d6fa6402f2f501d75"
server_key_version: "encryptionkey@0"
I20260812 02:43:01.758605 24539 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 02:43:01.760947 24567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:01.762218 24539 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:43:01.762354 24539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "d64368a582174781bc2cb9ae932c96f0"
format_stamp: "Formatted at 2026-08-12 02:43:01 on dist-test-slave-2p8l"
server_key: "a78f2b14b218937ebdf6c65a00887a11"
server_key_iv: "e4a2d58515294c3d6fa6402f2f501d75"
server_key_version: "encryptionkey@0"
I20260812 02:43:01.762463 24539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:01.776942 24539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:01.779733 24539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:01.779940 24539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:01.787860 24539 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:38387
I20260812 02:43:01.787885 24674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:38387 every 8 connection(s)
I20260812 02:43:01.789017 24539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:43:01.791894 24677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:01.795639 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 24539
I20260812 02:43:01.795763 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:43:01.796078 10541 external_mini_cluster.cc:1428] Setting key 8da5013e9832b95497dcec702aa2503b
I20260812 02:43:01.798297 24677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0: Bootstrap starting.
I20260812 02:43:01.801123 24677 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:01.802034 24677 log.cc:824] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0: Log is configured to *not* fsync() on all Append() calls
I20260812 02:43:01.804714 24677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0: No bootstrap required, opened a new log
Aug 12 02:43:01 dist-test-slave-2p8l krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM
I20260812 02:43:01.809156 24677 raft_consensus.cc:348] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d64368a582174781bc2cb9ae932c96f0" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 38387 } }
I20260812 02:43:01.809437 24677 raft_consensus.cc:374] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:01.809491 24677 raft_consensus.cc:729] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d64368a582174781bc2cb9ae932c96f0, State: Initialized, Role: FOLLOWER
I20260812 02:43:01.809947 24677 consensus_queue.cc:260] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d64368a582174781bc2cb9ae932c96f0" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 38387 } }
I20260812 02:43:01.810149 24677 raft_consensus.cc:388] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:43:01.810232 24677 raft_consensus.cc:482] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:43:01.810335 24677 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:01.811532 24677 raft_consensus.cc:504] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d64368a582174781bc2cb9ae932c96f0" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 38387 } }
I20260812 02:43:01.811882 24677 leader_election.cc:302] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d64368a582174781bc2cb9ae932c96f0; no voters:
I20260812 02:43:01.812233 24677 leader_election.cc:288] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:43:01.812345 24683 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:43:01.812615 24683 raft_consensus.cc:686] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0 [term 1 LEADER]: Becoming Leader. State: Replica: d64368a582174781bc2cb9ae932c96f0, State: Running, Role: LEADER
I20260812 02:43:01.812994 24681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:01.797534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51702 (local address 127.10.75.126:38387)
0812 02:43:01.798023 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:01.798042 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:01.798131 (+ 89us) server_negotiation.cc:407] Connection header received
0812 02:43:01.798978 (+ 847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:01.799015 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:01.799429 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:01.799807 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:01.800533 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:01.802042 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:01.803312 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:01.804452 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:01.804716 (+ 264us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:01.807565 (+ 2849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:01.807571 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:01.807588 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:01.807623 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:01.809641 (+ 2018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:01.810130 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:01.810136 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:01.810141 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:01.810292 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:01.810639 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:01.810644 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:01.810646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:01.811141 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:01.811332 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:01.811617 (+ 285us) server_negotiation.cc:299] Negotiation successful
0812 02:43:01.811918 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":119,"threads_started":1}
I20260812 02:43:01.812955 24683 consensus_queue.cc:237] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d64368a582174781bc2cb9ae932c96f0" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 38387 } }
I20260812 02:43:01.813519 24677 sys_catalog.cc:564] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:43:01.814189 24683 sys_catalog.cc:455] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d64368a582174781bc2cb9ae932c96f0. Latest consensus state: current_term: 1 leader_uuid: "d64368a582174781bc2cb9ae932c96f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d64368a582174781bc2cb9ae932c96f0" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 38387 } } }
I20260812 02:43:01.814308 24683 sys_catalog.cc:458] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0 [sys.catalog]: This master's current role is: LEADER
I20260812 02:43:01.815047 24684 sys_catalog.cc:455] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d64368a582174781bc2cb9ae932c96f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d64368a582174781bc2cb9ae932c96f0" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 38387 } } }
I20260812 02:43:01.815208 24684 sys_catalog.cc:458] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0 [sys.catalog]: This master's current role is: LEADER
W20260812 02:43:01.818524 24713 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:43:01.818614 24713 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:43:01.818737 24691 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:43:01.819396 24691 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:43:01.824260 24691 catalog_manager.cc:1347] Generated new cluster ID: f7fdd30ab6e0453faa251baa7cf0d111
I20260812 02:43:01.824326 24691 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:43:01.854380 24691 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:43:01.855386 24691 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:43:01.864760 24691 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0: Generated new TSK 0
I20260812 02:43:01.865451 24691 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.65.keytab.
Entry for principal oryx/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.65.keytab.
I20260812 02:43:01.901386 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:38387
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.65.keytab
--principal=oryx/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:33001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:43:02.039491 24728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:02.039768 24728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:02.039812 24728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:02.043807 24728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:02.043866 24728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:02.043905 24728 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 02:43:02.043937 24728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:43:02.049188 24728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:33001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.65.keytab
--principal=oryx/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.75.126:38387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24728
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:02.050263 24728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:02.051286 24728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:02.061390 24740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:02.061401 24748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:02.061403 24742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:02.061615 24728 server_base.cc:1034] running on GCE node
I20260812 02:43:02.062256 24728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:02.062949 24728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:02.064173 24728 hybrid_clock.cc:648] HybridClock initialized: now 1786502582064151 us; error 36 us; skew 500 ppm
Aug 12 02:43:02 dist-test-slave-2p8l krb5kdc[24514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502582, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:43:02.067268 24728 init.cc:377] Logged in from keytab as oryx/127.10.75.65@KRBTEST.COM (short username oryx)
I20260812 02:43:02.068253 24728 webserver.cc:460] Webserver started at http://127.10.75.65:44451/ using document root <none> and password file <none>
I20260812 02:43:02.068899 24728 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:02.068997 24728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:02.069237 24728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:02.071424 24728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "49eb39a0fcac4ddea84001be6f1f72a4"
format_stamp: "Formatted at 2026-08-12 02:43:02 on dist-test-slave-2p8l"
server_key: "29e0c1a626e0ed5c8a197f78e0aad88b"
server_key_iv: "7dc94404fff78c569f83ae33607b76a7"
server_key_version: "encryptionkey@0"
I20260812 02:43:02.072033 24728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "49eb39a0fcac4ddea84001be6f1f72a4"
format_stamp: "Formatted at 2026-08-12 02:43:02 on dist-test-slave-2p8l"
server_key: "29e0c1a626e0ed5c8a197f78e0aad88b"
server_key_iv: "7dc94404fff78c569f83ae33607b76a7"
server_key_version: "encryptionkey@0"
I20260812 02:43:02.076211 24728 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 02:43:02.078755 24770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:02.079994 24728 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:43:02.080143 24728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "49eb39a0fcac4ddea84001be6f1f72a4"
format_stamp: "Formatted at 2026-08-12 02:43:02 on dist-test-slave-2p8l"
server_key: "29e0c1a626e0ed5c8a197f78e0aad88b"
server_key_iv: "7dc94404fff78c569f83ae33607b76a7"
server_key_version: "encryptionkey@0"
I20260812 02:43:02.080263 24728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:02.103070 24728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:02.106393 24728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:02.106601 24728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:02.108006 24728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:43:02.108096 24728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:02.108170 24728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:43:02.108223 24728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 02:43:02 dist-test-slave-2p8l krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502582, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM
I20260812 02:43:02.119962 24728 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:40317
I20260812 02:43:02.121189 24728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:43:02.121797 24984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:40317 every 8 connection(s)
I20260812 02:43:02.123456 24681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.108928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:44485 (local address 127.10.75.126:38387)
0812 02:43:02.109063 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:02.109068 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:02.110264 (+ 1196us) server_negotiation.cc:407] Connection header received
0812 02:43:02.111295 (+ 1031us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:02.111300 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:02.111374 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:02.111439 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:02.113194 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.114135 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.115612 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.116057 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.116192 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.119037 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:02.119041 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:02.119044 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:02.119072 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:02.120973 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:02.121560 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:02.121564 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:02.121566 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:02.121672 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:02.122280 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:02.122284 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:02.122285 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:02.122488 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:02.122613 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:02.123127 (+ 514us) server_negotiation.cc:299] Negotiation successful
0812 02:43:02.123276 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 02:43:02.124205 24785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.109471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:38387 (local address 127.10.75.65:44485)
0812 02:43:02.110021 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:02.110145 (+ 124us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:02.111021 (+ 876us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:02.111890 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:02.111896 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:02.112364 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:02.113012 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.113033 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.114282 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.114286 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.115452 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.115462 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.116256 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.116262 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.116464 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.117157 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:02.117173 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:02.118833 (+ 1660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:43:02.121102 (+ 2269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:02.121107 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:02.121117 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:02.121443 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:02.121958 (+ 515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:02.121964 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:02.121967 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:02.122187 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:02.122613 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:43:02.122620 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:43:02.122863 (+ 243us) client_negotiation.cc:769] Sending connection context
0812 02:43:02.123064 (+ 201us) client_negotiation.cc:240] Negotiation successful
0812 02:43:02.123384 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":131,"threads_started":1}
I20260812 02:43:02.125490 24986 heartbeater.cc:347] Connected to a master server at 127.10.75.126:38387
I20260812 02:43:02.125663 24986 heartbeater.cc:464] Registering TS with master...
I20260812 02:43:02.126235 24986 heartbeater.cc:511] Master 127.10.75.126:38387 requested a full tablet report, sending...
I20260812 02:43:02.127979 24585 ts_manager.cc:194] Registered new tserver with Master: 49eb39a0fcac4ddea84001be6f1f72a4 (127.10.75.65:40317)
I20260812 02:43:02.129312 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 24728
I20260812 02:43:02.129460 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:43:02.129478 24585 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:44485
I20260812 02:43:02.129798 10541 external_mini_cluster.cc:1428] Setting key 03caeb8c0ccac776a0335552ca80f2a1
I20260812 02:43:02.136127 25001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.127821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:38387 (local address 127.10.75.65:52297)
0812 02:43:02.128166 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:02.128192 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:02.128296 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:02.128554 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:02.128557 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:02.128764 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:02.128886 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.128893 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.130025 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.130029 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.130871 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.130882 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.131595 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.131597 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.131666 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.132119 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:02.132130 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:02.132448 (+ 318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:43:02.134455 (+ 2007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:02.134461 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:02.134463 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:02.134745 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:02.135015 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:02.135020 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:02.135023 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:02.135129 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:02.135576 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:43:02.135581 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:43:02.135695 (+ 114us) client_negotiation.cc:769] Sending connection context
0812 02:43:02.135818 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 02:43:02.135964 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":109,"threads_started":1}
I20260812 02:43:02.136315 24681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.127981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:52297 (local address 127.10.75.126:38387)
0812 02:43:02.128146 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:02.128150 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:02.128273 (+ 123us) server_negotiation.cc:407] Connection header received
0812 02:43:02.128393 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:02.128395 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:02.128435 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:02.128503 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:02.129088 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.129883 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.131005 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.131326 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.131408 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.132596 (+ 1188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:02.132602 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:02.132607 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:02.132638 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:02.134333 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:02.134849 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:02.134851 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:02.134852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:02.134922 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:02.135267 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:02.135270 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:02.135271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:02.135462 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:02.135593 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:02.135926 (+ 333us) server_negotiation.cc:299] Negotiation successful
0812 02:43:02.136085 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
WARNING: no policy specified for oryx/127.10.75.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.75.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.66.keytab.
Entry for principal oryx/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.66.keytab.
I20260812 02:43:02.162029 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:38387
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.66.keytab
--principal=oryx/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:33001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:43:02.273538 25005 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:02.273782 25005 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:02.273824 25005 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:02.277781 25005 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:02.277835 25005 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:02.277873 25005 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 02:43:02.277905 25005 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:43:02.283022 25005 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:33001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.66.keytab
--principal=oryx/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.75.126:38387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25005
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:02.283974 25005 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:02.284999 25005 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:02.294286 25019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:02.294337 25015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:02.294492 25005 server_base.cc:1034] running on GCE node
W20260812 02:43:02.294286 25017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:02.295025 25005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:02.295682 25005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:02.296868 25005 hybrid_clock.cc:648] HybridClock initialized: now 1786502582296837 us; error 42 us; skew 500 ppm
Aug 12 02:43:02 dist-test-slave-2p8l krb5kdc[24514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502582, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:43:02.299605 25005 init.cc:377] Logged in from keytab as oryx/127.10.75.66@KRBTEST.COM (short username oryx)
I20260812 02:43:02.300410 25005 webserver.cc:460] Webserver started at http://127.10.75.66:35563/ using document root <none> and password file <none>
I20260812 02:43:02.300951 25005 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:02.301047 25005 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:02.301285 25005 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:02.303377 25005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "33bdee1f95224a3c84634833f7538e28"
format_stamp: "Formatted at 2026-08-12 02:43:02 on dist-test-slave-2p8l"
server_key: "99d610b38454cd42f273f4d1cc25ad7b"
server_key_iv: "12c70ecb444117fd38913d1ac9a415cc"
server_key_version: "encryptionkey@0"
I20260812 02:43:02.304014 25005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "33bdee1f95224a3c84634833f7538e28"
format_stamp: "Formatted at 2026-08-12 02:43:02 on dist-test-slave-2p8l"
server_key: "99d610b38454cd42f273f4d1cc25ad7b"
server_key_iv: "12c70ecb444117fd38913d1ac9a415cc"
server_key_version: "encryptionkey@0"
I20260812 02:43:02.307641 25005 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20260812 02:43:02.309875 25031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:02.311058 25005 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 02:43:02.311201 25005 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "33bdee1f95224a3c84634833f7538e28"
format_stamp: "Formatted at 2026-08-12 02:43:02 on dist-test-slave-2p8l"
server_key: "99d610b38454cd42f273f4d1cc25ad7b"
server_key_iv: "12c70ecb444117fd38913d1ac9a415cc"
server_key_version: "encryptionkey@0"
I20260812 02:43:02.311309 25005 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:02.328169 25005 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:02.331115 25005 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:02.331327 25005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:02.332691 25005 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:43:02.332768 25005 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:02.332834 25005 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:43:02.332886 25005 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 02:43:02 dist-test-slave-2p8l krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502582, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM
I20260812 02:43:02.344233 25005 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:33793
I20260812 02:43:02.344327 25247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:33793 every 8 connection(s)
I20260812 02:43:02.345139 25005 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:43:02.347610 24681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.333608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:52331 (local address 127.10.75.126:38387)
0812 02:43:02.333796 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:02.333803 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:02.334601 (+ 798us) server_negotiation.cc:407] Connection header received
0812 02:43:02.335539 (+ 938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:02.335542 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:02.335598 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:02.335684 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:02.337102 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.337998 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.339399 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.339628 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.339749 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.343751 (+ 4002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:02.343755 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:02.343757 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:02.343782 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:02.345497 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:02.346220 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:02.346224 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:02.346226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:02.346321 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:02.346656 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:02.346659 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:02.346660 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:02.346832 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:02.346907 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:02.347364 (+ 457us) server_negotiation.cc:299] Negotiation successful
0812 02:43:02.347467 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 02:43:02.348343 25049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.333921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:38387 (local address 127.10.75.66:52331)
0812 02:43:02.334425 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:02.334474 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:02.335316 (+ 842us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:02.335990 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:02.336001 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:02.336410 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:02.336934 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.336950 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.338177 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.338180 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.339247 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.339258 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.339823 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.339829 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.340035 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.340680 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:02.340707 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:02.343396 (+ 2689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:43:02.345660 (+ 2264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:02.345666 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:02.345679 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:02.346091 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:02.346425 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:02.346427 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:02.346429 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:02.346553 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:02.346922 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:43:02.346926 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:43:02.347123 (+ 197us) client_negotiation.cc:769] Sending connection context
0812 02:43:02.347275 (+ 152us) client_negotiation.cc:240] Negotiation successful
0812 02:43:02.347507 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":180,"threads_started":1}
I20260812 02:43:02.348894 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 25005
I20260812 02:43:02.349071 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:43:02.349373 10541 external_mini_cluster.cc:1428] Setting key b3fc3a99ae7ee768d859defbe60f8751
I20260812 02:43:02.349704 25248 heartbeater.cc:347] Connected to a master server at 127.10.75.126:38387
I20260812 02:43:02.349845 25248 heartbeater.cc:464] Registering TS with master...
I20260812 02:43:02.350423 25248 heartbeater.cc:511] Master 127.10.75.126:38387 requested a full tablet report, sending...
I20260812 02:43:02.351548 24585 ts_manager.cc:194] Registered new tserver with Master: 33bdee1f95224a3c84634833f7538e28 (127.10.75.66:33793)
I20260812 02:43:02.352306 24585 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:52331
WARNING: no policy specified for oryx/127.10.75.67@KRBTEST.COM; defaulting to no policy
I20260812 02:43:02.360532 24681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.353180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:54069 (local address 127.10.75.126:38387)
0812 02:43:02.353310 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:02.353315 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:02.353330 (+ 15us) server_negotiation.cc:407] Connection header received
0812 02:43:02.353372 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:02.353376 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:02.353426 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:02.353513 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:02.354018 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.354820 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.355624 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.356066 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.356184 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.357270 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:02.357273 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:02.357276 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:02.357303 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:02.358800 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:02.359249 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:02.359255 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:02.359259 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:02.359344 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:02.359633 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:02.359637 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:02.359639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:02.359854 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:02.359969 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:02.360245 (+ 276us) server_negotiation.cc:299] Negotiation successful
0812 02:43:02.360363 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 02:43:02.360551 25255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.351764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:38387 (local address 127.10.75.66:54069)
0812 02:43:02.352059 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:02.352074 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:02.352166 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:02.353562 (+ 1396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:02.353565 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:02.353779 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:02.353885 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.353892 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.354950 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.354953 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.355500 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.355508 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.356200 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.356203 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.356268 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.356793 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:02.356803 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:02.357111 (+ 308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:43:02.358922 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:02.358926 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:02.358929 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:02.359136 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:02.359443 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:02.359448 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:02.359450 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:02.359536 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:02.359960 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:43:02.359963 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:43:02.360055 (+ 92us) client_negotiation.cc:769] Sending connection context
0812 02:43:02.360185 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 02:43:02.360375 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":104,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.75.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.67.keytab.
Entry for principal oryx/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.67.keytab.
I20260812 02:43:02.381309 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:38387
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.67.keytab
--principal=oryx/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:33001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:43:02.492182 25263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:02.492414 25263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:02.492457 25263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:02.496359 25263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:02.496411 25263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:02.496448 25263 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 02:43:02.496480 25263 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:43:02.501502 25263 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:33001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.67.keytab
--principal=oryx/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.75.126:38387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25263
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:02.502511 25263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:02.503469 25263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 02:43:02.513106 25263 server_base.cc:1034] running on GCE node
W20260812 02:43:02.513057 25274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:02.513055 25273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:02.513083 25276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:02.513899 25263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:02.514633 25263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:02.515852 25263 hybrid_clock.cc:648] HybridClock initialized: now 1786502582515832 us; error 35 us; skew 500 ppm
Aug 12 02:43:02 dist-test-slave-2p8l krb5kdc[24514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502582, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:43:02.518714 25263 init.cc:377] Logged in from keytab as oryx/127.10.75.67@KRBTEST.COM (short username oryx)
I20260812 02:43:02.519567 25263 webserver.cc:460] Webserver started at http://127.10.75.67:35779/ using document root <none> and password file <none>
I20260812 02:43:02.520126 25263 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:02.520223 25263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:02.520453 25263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:02.522509 25263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "f6cd47af1a7340b498357543e150be3c"
format_stamp: "Formatted at 2026-08-12 02:43:02 on dist-test-slave-2p8l"
server_key: "5924ffea807949acdac40d38afbbabfd"
server_key_iv: "5fe0c24401f48fbe44d8d12756d2954f"
server_key_version: "encryptionkey@0"
I20260812 02:43:02.523083 25263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "f6cd47af1a7340b498357543e150be3c"
format_stamp: "Formatted at 2026-08-12 02:43:02 on dist-test-slave-2p8l"
server_key: "5924ffea807949acdac40d38afbbabfd"
server_key_iv: "5fe0c24401f48fbe44d8d12756d2954f"
server_key_version: "encryptionkey@0"
I20260812 02:43:02.526881 25263 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 02:43:02.529268 25289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:02.530552 25263 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:43:02.530709 25263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "f6cd47af1a7340b498357543e150be3c"
format_stamp: "Formatted at 2026-08-12 02:43:02 on dist-test-slave-2p8l"
server_key: "5924ffea807949acdac40d38afbbabfd"
server_key_iv: "5fe0c24401f48fbe44d8d12756d2954f"
server_key_version: "encryptionkey@0"
I20260812 02:43:02.530821 25263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:02.543906 25263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:02.547238 25263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:02.547451 25263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:02.549098 25263 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:43:02.549175 25263 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:02.549242 25263 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:43:02.549275 25263 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 02:43:02 dist-test-slave-2p8l krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502582, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM
I20260812 02:43:02.560711 25263 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:42679
I20260812 02:43:02.560801 25494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:42679 every 8 connection(s)
I20260812 02:43:02.561872 25263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:43:02.564057 24681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.550163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:45441 (local address 127.10.75.126:38387)
0812 02:43:02.550362 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:02.550369 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:02.551385 (+ 1016us) server_negotiation.cc:407] Connection header received
0812 02:43:02.552547 (+ 1162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:02.552553 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:02.552624 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:02.552737 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:02.554124 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.555016 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.556917 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.557307 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.557415 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.560214 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:02.560217 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:02.560221 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:02.560251 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:02.562039 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:02.562685 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:02.562688 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:02.562691 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:02.562785 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:02.563108 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:02.563112 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:02.563113 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:02.563312 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:02.563394 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:02.563834 (+ 440us) server_negotiation.cc:299] Negotiation successful
0812 02:43:02.563936 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 02:43:02.564908 25304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.550680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:38387 (local address 127.10.75.67:45441)
0812 02:43:02.551208 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:02.551260 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:02.552205 (+ 945us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:02.552966 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:02.552973 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:02.553421 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:02.553933 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.553947 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.555173 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.555180 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.556761 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.556776 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.557474 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.557479 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.557683 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.558395 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:02.558411 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:02.560015 (+ 1604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:43:02.562183 (+ 2168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:02.562188 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:02.562199 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:02.562557 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:02.562873 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:02.562876 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:02.562877 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:02.563000 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:02.563409 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:43:02.563414 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:43:02.563622 (+ 208us) client_negotiation.cc:769] Sending connection context
0812 02:43:02.563778 (+ 156us) client_negotiation.cc:240] Negotiation successful
0812 02:43:02.564015 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":137,"threads_started":1}
I20260812 02:43:02.566366 25495 heartbeater.cc:347] Connected to a master server at 127.10.75.126:38387
I20260812 02:43:02.566501 25495 heartbeater.cc:464] Registering TS with master...
I20260812 02:43:02.567090 25495 heartbeater.cc:511] Master 127.10.75.126:38387 requested a full tablet report, sending...
I20260812 02:43:02.568181 24586 ts_manager.cc:194] Registered new tserver with Master: f6cd47af1a7340b498357543e150be3c (127.10.75.67:42679)
I20260812 02:43:02.568257 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 25263
I20260812 02:43:02.568419 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:43:02.568789 10541 external_mini_cluster.cc:1428] Setting key 730ed5c0aa536386f0ee2712859181d7
I20260812 02:43:02.568995 24586 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:45441
I20260812 02:43:02.570910 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:43:02.576356 25507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.568642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:38387 (local address 127.10.75.67:48327)
0812 02:43:02.568965 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:02.568980 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:02.569114 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:02.569383 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:02.569387 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:02.569610 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:02.569739 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.569746 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.570693 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.570699 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.571340 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.571349 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.571949 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.571952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.572022 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.572538 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:02.572549 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:02.572859 (+ 310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:43:02.574807 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:02.574814 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:02.574819 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:02.575095 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:02.575423 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:02.575425 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:02.575427 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:02.575504 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:02.575955 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:43:02.575957 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:43:02.576027 (+ 70us) client_negotiation.cc:769] Sending connection context
0812 02:43:02.576108 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 02:43:02.576216 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":113,"threads_started":1}
I20260812 02:43:02.576594 24681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.568695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:48327 (local address 127.10.75.126:38387)
0812 02:43:02.569182 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:02.569187 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:02.569201 (+ 14us) server_negotiation.cc:407] Connection header received
0812 02:43:02.569240 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:02.569243 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:02.569290 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:02.569369 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:02.569903 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.570498 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.571462 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.571830 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.571954 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.573007 (+ 1053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:02.573014 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:02.573020 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:02.573052 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:02.574689 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:02.575203 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:02.575210 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:02.575214 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:02.575306 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:02.575603 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:02.575609 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:02.575614 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:02.575853 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:02.575960 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:02.576206 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 02:43:02.576352 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406}
Aug 12 02:43:02 dist-test-slave-2p8l krb5kdc[24514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502582, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 02:43:02 dist-test-slave-2p8l krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:02 dist-test-slave-2p8l krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 02:43:02.596853 24681 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:02.590880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51718 (local address 127.10.75.126:38387)
0812 02:43:02.591008 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:02.591011 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:02.591026 (+ 15us) server_negotiation.cc:407] Connection header received
0812 02:43:02.591061 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:02.591064 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:02.591100 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:02.591177 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:02.591861 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.592371 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.593202 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.593406 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.593484 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.596722 (+ 3238us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51718: BlockingRecv error: recv got EOF from 127.0.0.1:51718 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 02:43:02 dist-test-slave-2p8l krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502582, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM
I20260812 02:43:02.606186 24681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.598298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51720 (local address 127.10.75.126:38387)
0812 02:43:02.598417 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:02.598423 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:02.598595 (+ 172us) server_negotiation.cc:407] Connection header received
0812 02:43:02.598760 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:02.598763 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:02.598808 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:02.598893 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:02.599473 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.599960 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.600772 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.600983 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.601092 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.603423 (+ 2331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:02.603426 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:02.603428 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:02.603450 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:02.604684 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:02.605055 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:02.605058 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:02.605059 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:02.605129 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:02.605371 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:02.605373 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:02.605374 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:02.605530 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:02.605632 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:02.605837 (+ 205us) server_negotiation.cc:299] Negotiation successful
0812 02:43:02.605926 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 02:43:02.609077 24586 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51720:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:43:02.612193 24586 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:43:02.627084 25534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.620764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:40317 (local address 127.0.0.1:38830)
0812 02:43:02.621578 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:02.621635 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:02.621783 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:02.622476 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:02.622481 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:02.622504 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:43:02.622643 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.622653 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.623876 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.623880 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.625296 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.625307 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.626504 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.626509 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.626616 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.626654 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 02:43:02.626777 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 02:43:02.626898 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"mutex_wait_us":12,"thread_start_us":77,"threads_started":1}
I20260812 02:43:02.627104 25537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.620949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38830 (local address 127.10.75.65:40317)
0812 02:43:02.621247 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:02.621266 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:02.621952 (+ 686us) server_negotiation.cc:407] Connection header received
0812 02:43:02.622051 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:02.622092 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:02.622309 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:02.622482 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:43:02.622771 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.623770 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.625433 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.626362 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.626474 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.626643 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:02.626852 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 02:43:02.626953 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":107,"threads_started":1}
I20260812 02:43:02.627666 25539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.621771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52146 (local address 127.10.75.67:42679)
0812 02:43:02.622692 (+ 921us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:02.622701 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:02.622719 (+ 18us) server_negotiation.cc:407] Connection header received
0812 02:43:02.622777 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:02.622780 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:02.622902 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:02.623008 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:43:02.623326 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.624410 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.625773 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.626381 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.626557 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.626730 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:02.627042 (+ 312us) server_negotiation.cc:299] Negotiation successful
0812 02:43:02.627493 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":821,"thread_start_us":123,"threads_started":1}
I20260812 02:43:02.628185 25538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.621458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:42679 (local address 127.0.0.1:52146)
0812 02:43:02.622027 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:02.622040 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:02.622164 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:02.623053 (+ 889us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:02.623056 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:02.623076 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:43:02.623183 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.623189 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.624574 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.624577 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.625650 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.625657 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.626794 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.626797 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.626888 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.626909 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 02:43:02.627926 (+ 1017us) client_negotiation.cc:240] Negotiation successful
0812 02:43:02.628036 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"mutex_wait_us":7,"thread_start_us":97,"threads_started":1}
I20260812 02:43:02.628201 25541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.621826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:33793 (local address 127.0.0.1:34804)
0812 02:43:02.622205 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:02.622341 (+ 136us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:02.622445 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:02.623685 (+ 1240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:02.623688 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:02.623706 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:43:02.623799 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.623808 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.625193 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.625199 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.626469 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.626479 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.627737 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.627740 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.627836 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.627865 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 02:43:02.627918 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 02:43:02.627991 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":82,"threads_started":1}
I20260812 02:43:02.628942 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.622268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34804 (local address 127.10.75.66:33793)
0812 02:43:02.623228 (+ 960us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:02.623235 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:02.623286 (+ 51us) server_negotiation.cc:407] Connection header received
0812 02:43:02.623357 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:02.623363 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:02.623535 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:02.623697 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:43:02.623958 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.625069 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.626625 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.627593 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.628430 (+ 837us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.628608 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:02.628662 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 02:43:02.628781 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":879,"thread_start_us":115,"threads_started":1}
I20260812 02:43:02.630335 24857 tablet_service.cc:1467] Processing CreateTablet for tablet 32822d9db8a44118983ec6d01928f11e (DEFAULT_TABLE table=test-table [id=1a0d7b8883c74d5f852841527e2a8c5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:43:02.631048 25385 tablet_service.cc:1467] Processing CreateTablet for tablet 32822d9db8a44118983ec6d01928f11e (DEFAULT_TABLE table=test-table [id=1a0d7b8883c74d5f852841527e2a8c5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:43:02.631605 24857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32822d9db8a44118983ec6d01928f11e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:02.631490 25122 tablet_service.cc:1467] Processing CreateTablet for tablet 32822d9db8a44118983ec6d01928f11e (DEFAULT_TABLE table=test-table [id=1a0d7b8883c74d5f852841527e2a8c5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:43:02.632033 25385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32822d9db8a44118983ec6d01928f11e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:02.632402 25122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32822d9db8a44118983ec6d01928f11e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:02.638872 25544 tablet_bootstrap.cc:492] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c: Bootstrap starting.
I20260812 02:43:02.639875 25549 tablet_bootstrap.cc:492] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28: Bootstrap starting.
I20260812 02:43:02.641237 25544 tablet_bootstrap.cc:654] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:02.641551 25549 tablet_bootstrap.cc:654] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:02.642127 25544 log.cc:824] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c: Log is configured to *not* fsync() on all Append() calls
I20260812 02:43:02.642351 25549 log.cc:824] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28: Log is configured to *not* fsync() on all Append() calls
I20260812 02:43:02.643023 25547 tablet_bootstrap.cc:492] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4: Bootstrap starting.
I20260812 02:43:02.644294 25549 tablet_bootstrap.cc:492] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28: No bootstrap required, opened a new log
I20260812 02:43:02.644292 25544 tablet_bootstrap.cc:492] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c: No bootstrap required, opened a new log
I20260812 02:43:02.644475 25549 ts_tablet_manager.cc:1397] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 02:43:02.644475 25544 ts_tablet_manager.cc:1397] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 02:43:02.644634 25547 tablet_bootstrap.cc:654] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:02.645493 25547 log.cc:824] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4: Log is configured to *not* fsync() on all Append() calls
I20260812 02:43:02.647044 25547 tablet_bootstrap.cc:492] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4: No bootstrap required, opened a new log
I20260812 02:43:02.647246 25547 ts_tablet_manager.cc:1397] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 02:43:02.648478 25549 raft_consensus.cc:348] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } }
I20260812 02:43:02.648478 25544 raft_consensus.cc:348] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } }
I20260812 02:43:02.648751 25544 raft_consensus.cc:374] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:02.648751 25549 raft_consensus.cc:374] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:02.648813 25549 raft_consensus.cc:729] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33bdee1f95224a3c84634833f7538e28, State: Initialized, Role: FOLLOWER
I20260812 02:43:02.648813 25544 raft_consensus.cc:729] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6cd47af1a7340b498357543e150be3c, State: Initialized, Role: FOLLOWER
I20260812 02:43:02.649266 25549 consensus_queue.cc:260] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } }
I20260812 02:43:02.649696 25544 consensus_queue.cc:260] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } }
I20260812 02:43:02.650344 25549 ts_tablet_manager.cc:1428] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28: Time spent starting tablet: real 0.006s user 0.002s sys 0.005s
I20260812 02:43:02.650467 25495 heartbeater.cc:503] Master 127.10.75.126:38387 was elected leader, sending a full tablet report...
I20260812 02:43:02.650664 25248 heartbeater.cc:503] Master 127.10.75.126:38387 was elected leader, sending a full tablet report...
I20260812 02:43:02.651021 25547 raft_consensus.cc:348] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } }
I20260812 02:43:02.651238 25547 raft_consensus.cc:374] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:02.651289 25547 raft_consensus.cc:729] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49eb39a0fcac4ddea84001be6f1f72a4, State: Initialized, Role: FOLLOWER
I20260812 02:43:02.651685 25547 consensus_queue.cc:260] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } }
I20260812 02:43:02.651783 25544 ts_tablet_manager.cc:1428] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 02:43:02.652525 25547 ts_tablet_manager.cc:1428] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 02:43:02.652828 24986 heartbeater.cc:503] Master 127.10.75.126:38387 was elected leader, sending a full tablet report...
I20260812 02:43:02.725878 25556 raft_consensus.cc:482] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:43:02.726212 25556 raft_consensus.cc:504] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } }
I20260812 02:43:02.727427 25556 leader_election.cc:288] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49eb39a0fcac4ddea84001be6f1f72a4 (127.10.75.65:40317), f6cd47af1a7340b498357543e150be3c (127.10.75.67:42679)
I20260812 02:43:02.732376 25537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.727866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:60745 (local address 127.10.75.65:40317)
0812 02:43:02.728072 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:02.728077 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:02.728103 (+ 26us) server_negotiation.cc:407] Connection header received
0812 02:43:02.728175 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:02.728179 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:02.728241 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:02.728344 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:43:02.728677 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.729676 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.731118 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.731813 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.731945 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.732003 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:02.732197 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 02:43:02.732266 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 02:43:02.732378 25049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.727790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:40317 (local address 127.10.75.66:60745)
0812 02:43:02.727924 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:02.727946 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:02.728033 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:02.728370 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:02.728376 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:02.728401 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:43:02.728528 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.728540 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.729830 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.729834 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.730977 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.730986 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.731942 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.731944 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.732028 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.732049 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 02:43:02.732161 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 02:43:02.732243 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 02:43:02.733157 24900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32822d9db8a44118983ec6d01928f11e" candidate_uuid: "33bdee1f95224a3c84634833f7538e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" is_pre_election: true
I20260812 02:43:02.733278 25539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.728289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:34695 (local address 127.10.75.67:42679)
0812 02:43:02.728456 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:02.728461 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:02.728738 (+ 277us) server_negotiation.cc:407] Connection header received
0812 02:43:02.728854 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:02.728857 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:02.728897 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:02.728957 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:43:02.729831 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.730614 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.732143 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.732730 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.732869 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.732916 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:02.733096 (+ 180us) server_negotiation.cc:299] Negotiation successful
0812 02:43:02.733163 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260812 02:43:02.733305 25562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.728145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:42679 (local address 127.10.75.66:34695)
0812 02:43:02.728624 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:02.728642 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:02.728756 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:02.729022 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:02.729025 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:02.729045 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:43:02.729690 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.729701 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.730749 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.730752 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.731987 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:02.732011 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.732871 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.732875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:02.732973 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.732990 (+ 17us) client_negotiation.cc:769] Sending connection context
0812 02:43:02.733082 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 02:43:02.733145 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"mutex_wait_us":1,"thread_start_us":170,"threads_started":1}
I20260812 02:43:02.733537 24900 raft_consensus.cc:2454] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33bdee1f95224a3c84634833f7538e28 in term 0.
I20260812 02:43:02.733853 25416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32822d9db8a44118983ec6d01928f11e" candidate_uuid: "33bdee1f95224a3c84634833f7538e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6cd47af1a7340b498357543e150be3c" is_pre_election: true
I20260812 02:43:02.734177 25416 raft_consensus.cc:2454] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33bdee1f95224a3c84634833f7538e28 in term 0.
I20260812 02:43:02.734144 25032 leader_election.cc:302] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33bdee1f95224a3c84634833f7538e28, 49eb39a0fcac4ddea84001be6f1f72a4; no voters:
I20260812 02:43:02.734519 25556 raft_consensus.cc:2781] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:43:02.734632 25556 raft_consensus.cc:482] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:43:02.734692 25556 raft_consensus.cc:3037] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:02.735816 25556 raft_consensus.cc:504] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } }
I20260812 02:43:02.736155 25556 leader_election.cc:288] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [CANDIDATE]: Term 1 election: Requested vote from peers 49eb39a0fcac4ddea84001be6f1f72a4 (127.10.75.65:40317), f6cd47af1a7340b498357543e150be3c (127.10.75.67:42679)
I20260812 02:43:02.736611 24900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32822d9db8a44118983ec6d01928f11e" candidate_uuid: "33bdee1f95224a3c84634833f7538e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49eb39a0fcac4ddea84001be6f1f72a4"
I20260812 02:43:02.736749 25416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32822d9db8a44118983ec6d01928f11e" candidate_uuid: "33bdee1f95224a3c84634833f7538e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6cd47af1a7340b498357543e150be3c"
I20260812 02:43:02.736773 24900 raft_consensus.cc:3037] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:02.736893 25416 raft_consensus.cc:3037] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:02.737885 24900 raft_consensus.cc:2454] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33bdee1f95224a3c84634833f7538e28 in term 1.
I20260812 02:43:02.737903 25416 raft_consensus.cc:2454] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33bdee1f95224a3c84634833f7538e28 in term 1.
I20260812 02:43:02.738219 25032 leader_election.cc:302] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33bdee1f95224a3c84634833f7538e28, 49eb39a0fcac4ddea84001be6f1f72a4; no voters:
I20260812 02:43:02.738409 25556 raft_consensus.cc:2781] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:43:02.738642 25556 raft_consensus.cc:686] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [term 1 LEADER]: Becoming Leader. State: Replica: 33bdee1f95224a3c84634833f7538e28, State: Running, Role: LEADER
I20260812 02:43:02.738996 25556 consensus_queue.cc:237] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } }
I20260812 02:43:02.742408 24585 catalog_manager.cc:5495] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33bdee1f95224a3c84634833f7538e28 (127.10.75.66). New cstate: current_term: 1 leader_uuid: "33bdee1f95224a3c84634833f7538e28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } health_report { overall_health: HEALTHY } } }
I20260812 02:43:02.778846 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:02.775543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34806 (local address 127.10.75.66:33793)
0812 02:43:02.775682 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:02.775686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:02.775700 (+ 14us) server_negotiation.cc:407] Connection header received
0812 02:43:02.775778 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:02.775781 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:02.775834 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:02.775925 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:43:02.776210 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.776719 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.777531 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:02.777742 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:02.777817 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:02.778079 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:43:02.778514 (+ 435us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:43:02.778602 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:02.778679 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 02:43:02.778730 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 02:43:02.784791 25416 raft_consensus.cc:1261] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c [term 1 FOLLOWER]: Refusing update from remote peer 33bdee1f95224a3c84634833f7538e28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:43:02.784791 24900 raft_consensus.cc:1261] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 FOLLOWER]: Refusing update from remote peer 33bdee1f95224a3c84634833f7538e28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:43:02.785560 25563 consensus_queue.cc:1035] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:43:02.785796 25556 consensus_queue.cc:1035] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:43:02.794015 25571 mvcc.cc:205] Tried to move back new op lower bound from 7317514579078774784 to 7317514578901528576. Current Snapshot: MvccSnapshot[applied={T|T < 7317514579078774784}]
I20260812 02:43:02.796211 25576 mvcc.cc:205] Tried to move back new op lower bound from 7317514579078774784 to 7317514578901528576. Current Snapshot: MvccSnapshot[applied={T|T < 7317514579078774784}]
I20260812 02:43:02.809772 24585 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:43:02.809973 24585 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:43:02.812503 24585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0: Sending DeleteTablet for 3 replicas of tablet 32822d9db8a44118983ec6d01928f11e
I20260812 02:43:02.813542 25122 tablet_service.cc:1514] Processing DeleteTablet for tablet 32822d9db8a44118983ec6d01928f11e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:43:02 UTC) from {username='oryx', principal='oryx/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:34804
I20260812 02:43:02.813759 24857 tablet_service.cc:1514] Processing DeleteTablet for tablet 32822d9db8a44118983ec6d01928f11e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:43:02 UTC) from {username='oryx', principal='oryx/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:38830
I20260812 02:43:02.813807 25385 tablet_service.cc:1514] Processing DeleteTablet for tablet 32822d9db8a44118983ec6d01928f11e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:43:02 UTC) from {username='oryx', principal='oryx/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:52146
I20260812 02:43:02.814721 25591 tablet_replica.cc:330] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4: stopping tablet replica
I20260812 02:43:02.815083 25591 raft_consensus.cc:2229] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:43:02.815461 25591 raft_consensus.cc:2258] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:43:02.815932 25594 tablet_replica.cc:330] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c: stopping tablet replica
I20260812 02:43:02.815825 24585 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51720:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 02:43:02.816282 25594 raft_consensus.cc:2229] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260812 02:43:02.816370 24585 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:43:02.816606 25594 raft_consensus.cc:2258] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:43:02.816941 25589 tablet_replica.cc:330] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28: stopping tablet replica
I20260812 02:43:02.817261 25589 raft_consensus.cc:2229] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:43:02.817674 25589 raft_consensus.cc:2258] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:43:02.819193 25589 ts_tablet_manager.cc:1905] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:43:02.819248 25591 ts_tablet_manager.cc:1905] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:43:02.821972 25589 ts_tablet_manager.cc:1918] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:43:02.822110 25589 log.cc:1196] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/32822d9db8a44118983ec6d01928f11e
I20260812 02:43:02.822467 25589 ts_tablet_manager.cc:1939] T 32822d9db8a44118983ec6d01928f11e P 33bdee1f95224a3c84634833f7538e28: Deleting consensus metadata
I20260812 02:43:02.822978 25591 ts_tablet_manager.cc:1918] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:43:02.823199 25591 log.cc:1196] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/wal/wals/32822d9db8a44118983ec6d01928f11e
I20260812 02:43:02.823359 24857 tablet_service.cc:1467] Processing CreateTablet for tablet 6f13c487416642f09bacda61986cb255 (DEFAULT_TABLE table=test-table [id=cef29385f76d4d08b9dfe0aec44d5f69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:43:02.823695 24857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f13c487416642f09bacda61986cb255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:02.823803 25591 ts_tablet_manager.cc:1939] T 32822d9db8a44118983ec6d01928f11e P 49eb39a0fcac4ddea84001be6f1f72a4: Deleting consensus metadata
I20260812 02:43:02.823884 25385 tablet_service.cc:1467] Processing CreateTablet for tablet 6f13c487416642f09bacda61986cb255 (DEFAULT_TABLE table=test-table [id=cef29385f76d4d08b9dfe0aec44d5f69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:43:02.824378 25385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f13c487416642f09bacda61986cb255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:02.826190 25547 tablet_bootstrap.cc:492] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4: Bootstrap starting.
I20260812 02:43:02.826436 24568 catalog_manager.cc:4841] TS 49eb39a0fcac4ddea84001be6f1f72a4 (127.10.75.65:40317): tablet 32822d9db8a44118983ec6d01928f11e (table test-table [id=1a0d7b8883c74d5f852841527e2a8c5a]) successfully deleted
I20260812 02:43:02.827172 25544 tablet_bootstrap.cc:492] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c: Bootstrap starting.
I20260812 02:43:02.827346 25547 tablet_bootstrap.cc:654] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:02.827440 25122 tablet_service.cc:1467] Processing CreateTablet for tablet 6f13c487416642f09bacda61986cb255 (DEFAULT_TABLE table=test-table [id=cef29385f76d4d08b9dfe0aec44d5f69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:43:02.827759 25122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f13c487416642f09bacda61986cb255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:02.828327 25544 tablet_bootstrap.cc:654] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:02.829239 24568 catalog_manager.cc:4841] TS 33bdee1f95224a3c84634833f7538e28 (127.10.75.66:33793): tablet 32822d9db8a44118983ec6d01928f11e (table test-table [id=1a0d7b8883c74d5f852841527e2a8c5a]) successfully deleted
I20260812 02:43:02.829732 25544 tablet_bootstrap.cc:492] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c: No bootstrap required, opened a new log
I20260812 02:43:02.829826 25544 ts_tablet_manager.cc:1397] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 02:43:02.830163 25547 tablet_bootstrap.cc:492] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4: No bootstrap required, opened a new log
I20260812 02:43:02.830246 25547 ts_tablet_manager.cc:1397] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 02:43:02.830390 25544 raft_consensus.cc:348] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:02.830520 25544 raft_consensus.cc:374] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:02.830559 25544 raft_consensus.cc:729] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6cd47af1a7340b498357543e150be3c, State: Initialized, Role: FOLLOWER
I20260812 02:43:02.830760 25547 raft_consensus.cc:348] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:02.830843 25549 tablet_bootstrap.cc:492] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28: Bootstrap starting.
I20260812 02:43:02.830878 25547 raft_consensus.cc:374] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:02.830915 25547 raft_consensus.cc:729] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49eb39a0fcac4ddea84001be6f1f72a4, State: Initialized, Role: FOLLOWER
I20260812 02:43:02.831066 25547 consensus_queue.cc:260] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:02.831393 25547 ts_tablet_manager.cc:1428] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 02:43:02.831943 25549 tablet_bootstrap.cc:654] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:02.833216 25594 ts_tablet_manager.cc:1905] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:43:02.833346 25549 tablet_bootstrap.cc:492] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28: No bootstrap required, opened a new log
I20260812 02:43:02.833453 25549 ts_tablet_manager.cc:1397] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 02:43:02.833386 25544 consensus_queue.cc:260] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:02.834087 25549 raft_consensus.cc:348] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:02.834221 25549 raft_consensus.cc:374] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:02.834281 25549 raft_consensus.cc:729] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33bdee1f95224a3c84634833f7538e28, State: Initialized, Role: FOLLOWER
I20260812 02:43:02.834424 25544 ts_tablet_manager.cc:1428] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260812 02:43:02.834426 25549 consensus_queue.cc:260] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:02.834832 25549 ts_tablet_manager.cc:1428] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260812 02:43:02.837085 25594 ts_tablet_manager.cc:1918] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:43:02.837191 25594 log.cc:1196] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/32822d9db8a44118983ec6d01928f11e
I20260812 02:43:02.837569 25594 ts_tablet_manager.cc:1939] T 32822d9db8a44118983ec6d01928f11e P f6cd47af1a7340b498357543e150be3c: Deleting consensus metadata
I20260812 02:43:02.838958 24568 catalog_manager.cc:4841] TS f6cd47af1a7340b498357543e150be3c (127.10.75.67:42679): tablet 32822d9db8a44118983ec6d01928f11e (table test-table [id=1a0d7b8883c74d5f852841527e2a8c5a]) successfully deleted
W20260812 02:43:02.846793 25250 tablet.cc:2369] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 02:43:02.873162 24990 tablet.cc:2369] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 02:43:03.063879 25497 tablet.cc:2369] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:43:03.128974 25561 raft_consensus.cc:482] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:43:03.129132 25561 raft_consensus.cc:504] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.130285 25561 leader_election.cc:288] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33bdee1f95224a3c84634833f7538e28 (127.10.75.66:33793), f6cd47af1a7340b498357543e150be3c (127.10.75.67:42679)
I20260812 02:43:03.134706 25599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:03.130471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:33793 (local address 127.10.75.65:37013)
0812 02:43:03.130731 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:03.130750 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:03.130859 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:03.131291 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:03.131293 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:03.131302 (+ 9us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:43:03.131435 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:03.131442 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.132463 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.132469 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:03.133356 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:03.133367 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.134217 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.134221 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:03.134311 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:03.134337 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 02:43:03.134468 (+ 131us) client_negotiation.cc:240] Negotiation successful
0812 02:43:03.134544 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":41,"thread_start_us":101,"threads_started":1}
I20260812 02:43:03.134704 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:03.130616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:37013 (local address 127.10.75.66:33793)
0812 02:43:03.130752 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:03.130757 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:03.130915 (+ 158us) server_negotiation.cc:407] Connection header received
0812 02:43:03.130975 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:03.130979 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:03.131028 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:03.131111 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:43:03.131554 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.132335 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.133497 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.134090 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.134228 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:03.134282 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:03.134489 (+ 207us) server_negotiation.cc:299] Negotiation successful
0812 02:43:03.134564 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 02:43:03.135443 25539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:03.131281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:35675 (local address 127.10.75.67:42679)
0812 02:43:03.131438 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:03.131443 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:03.131457 (+ 14us) server_negotiation.cc:407] Connection header received
0812 02:43:03.131514 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:03.131518 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:03.131565 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:03.131653 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:43:03.131908 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.132424 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.133935 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.134549 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.134673 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:03.134720 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:03.135252 (+ 532us) server_negotiation.cc:299] Negotiation successful
0812 02:43:03.135327 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 02:43:03.135560 25160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f13c487416642f09bacda61986cb255" candidate_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33bdee1f95224a3c84634833f7538e28" is_pre_election: true
I20260812 02:43:03.135824 25160 raft_consensus.cc:2454] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49eb39a0fcac4ddea84001be6f1f72a4 in term 0.
I20260812 02:43:03.136052 25601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:03.130854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:42679 (local address 127.10.75.65:35675)
0812 02:43:03.131119 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:03.131132 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:03.131212 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:03.131684 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:03.131687 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:03.131703 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:43:03.131799 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:03.131804 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.132542 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.132546 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:03.133811 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:03.133821 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.134791 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.134895 (+ 104us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:03.134992 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:03.135010 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 02:43:03.135107 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 02:43:03.135186 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":101,"threads_started":1}
I20260812 02:43:03.136255 24771 leader_election.cc:302] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33bdee1f95224a3c84634833f7538e28, 49eb39a0fcac4ddea84001be6f1f72a4; no voters:
I20260812 02:43:03.136505 25561 raft_consensus.cc:2781] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:43:03.136579 25561 raft_consensus.cc:482] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:43:03.136632 25561 raft_consensus.cc:3037] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:03.136878 25415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f13c487416642f09bacda61986cb255" candidate_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6cd47af1a7340b498357543e150be3c" is_pre_election: true
I20260812 02:43:03.137007 25415 raft_consensus.cc:2454] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49eb39a0fcac4ddea84001be6f1f72a4 in term 0.
I20260812 02:43:03.137889 25561 raft_consensus.cc:504] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.138306 25561 leader_election.cc:288] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [CANDIDATE]: Term 1 election: Requested vote from peers 33bdee1f95224a3c84634833f7538e28 (127.10.75.66:33793), f6cd47af1a7340b498357543e150be3c (127.10.75.67:42679)
I20260812 02:43:03.138628 25160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f13c487416642f09bacda61986cb255" candidate_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33bdee1f95224a3c84634833f7538e28"
I20260812 02:43:03.138759 25160 raft_consensus.cc:3037] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:03.138710 25415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f13c487416642f09bacda61986cb255" candidate_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6cd47af1a7340b498357543e150be3c"
I20260812 02:43:03.138845 25415 raft_consensus.cc:3037] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:03.139730 25160 raft_consensus.cc:2454] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49eb39a0fcac4ddea84001be6f1f72a4 in term 1.
I20260812 02:43:03.139786 25415 raft_consensus.cc:2454] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49eb39a0fcac4ddea84001be6f1f72a4 in term 1.
I20260812 02:43:03.140014 24771 leader_election.cc:302] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33bdee1f95224a3c84634833f7538e28, 49eb39a0fcac4ddea84001be6f1f72a4; no voters:
I20260812 02:43:03.140241 25561 raft_consensus.cc:2781] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:43:03.140514 25561 raft_consensus.cc:686] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 LEADER]: Becoming Leader. State: Replica: 49eb39a0fcac4ddea84001be6f1f72a4, State: Running, Role: LEADER
I20260812 02:43:03.140780 25561 consensus_queue.cc:237] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.143250 24586 catalog_manager.cc:5495] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49eb39a0fcac4ddea84001be6f1f72a4 (127.10.75.65). New cstate: current_term: 1 leader_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } health_report { overall_health: UNKNOWN } } }
Aug 12 02:43:03 dist-test-slave-2p8l krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502581, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.126@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM
I20260812 02:43:03.224951 25616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:03.216127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51736 (local address 127.10.75.126:38387)
0812 02:43:03.216401 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:03.216409 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:03.216521 (+ 112us) server_negotiation.cc:407] Connection header received
0812 02:43:03.216712 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:03.216714 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:03.216777 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:03.216876 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:03.217574 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.218195 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.218989 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.219259 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.219374 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:03.221674 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:03.221678 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:03.221680 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:03.221701 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:03.223170 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:03.223631 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:03.223637 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:03.223638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:03.223725 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:03.224020 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:03.224023 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:03.224025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:03.224203 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:03.224311 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:03.224632 (+ 321us) server_negotiation.cc:299] Negotiation successful
0812 02:43:03.224828 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":69,"server-negotiator.queue_time_us":226,"thread_start_us":139,"threads_started":1}
I20260812 02:43:03.224951 25615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:03.216083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:38387 (local address 127.0.0.1:51736)
0812 02:43:03.216406 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:03.216424 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:03.216583 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:03.216919 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:03.216922 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:03.217351 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:03.217443 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:03.217449 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.218311 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.218315 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:03.218865 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:03.218872 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.219379 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.219382 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:03.219465 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:03.220038 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:03.220049 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:03.221503 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:43:03.223281 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:03.223293 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:03.223300 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:03.223529 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:03.223831 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:03.223834 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:03.223836 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:03.223921 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:03.224312 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:43:03.224320 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:43:03.224434 (+ 114us) client_negotiation.cc:769] Sending connection context
0812 02:43:03.224572 (+ 138us) client_negotiation.cc:240] Negotiation successful
0812 02:43:03.224740 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":101,"threads_started":1}
I20260812 02:43:03.229014 24586 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:51736:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 02:43:03.229802 24586 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:43:03.234700 24857 tablet_service.cc:1467] Processing CreateTablet for tablet 08ceffba08b7484eba80f991681ae857 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f1071cee9d834b7ab93e9add7902571f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 02:43:03.234736 25122 tablet_service.cc:1467] Processing CreateTablet for tablet 08ceffba08b7484eba80f991681ae857 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f1071cee9d834b7ab93e9add7902571f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 02:43:03.234875 25385 tablet_service.cc:1467] Processing CreateTablet for tablet 08ceffba08b7484eba80f991681ae857 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f1071cee9d834b7ab93e9add7902571f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 02:43:03.235112 24857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08ceffba08b7484eba80f991681ae857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:03.235127 25122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08ceffba08b7484eba80f991681ae857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:03.235332 25385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08ceffba08b7484eba80f991681ae857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:03.237950 25549 tablet_bootstrap.cc:492] T 08ceffba08b7484eba80f991681ae857 P 33bdee1f95224a3c84634833f7538e28: Bootstrap starting.
I20260812 02:43:03.237972 25547 tablet_bootstrap.cc:492] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4: Bootstrap starting.
I20260812 02:43:03.238920 25547 tablet_bootstrap.cc:654] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:03.238920 25549 tablet_bootstrap.cc:654] T 08ceffba08b7484eba80f991681ae857 P 33bdee1f95224a3c84634833f7538e28: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:03.239576 25544 tablet_bootstrap.cc:492] T 08ceffba08b7484eba80f991681ae857 P f6cd47af1a7340b498357543e150be3c: Bootstrap starting.
I20260812 02:43:03.240294 25547 tablet_bootstrap.cc:492] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4: No bootstrap required, opened a new log
I20260812 02:43:03.240355 25549 tablet_bootstrap.cc:492] T 08ceffba08b7484eba80f991681ae857 P 33bdee1f95224a3c84634833f7538e28: No bootstrap required, opened a new log
I20260812 02:43:03.240410 25547 ts_tablet_manager.cc:1397] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 02:43:03.240444 25549 ts_tablet_manager.cc:1397] T 08ceffba08b7484eba80f991681ae857 P 33bdee1f95224a3c84634833f7538e28: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 02:43:03.240594 25544 tablet_bootstrap.cc:654] T 08ceffba08b7484eba80f991681ae857 P f6cd47af1a7340b498357543e150be3c: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:03.240880 25547 raft_consensus.cc:348] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.240903 25549 raft_consensus.cc:348] T 08ceffba08b7484eba80f991681ae857 P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.241008 25547 raft_consensus.cc:374] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:03.241019 25549 raft_consensus.cc:374] T 08ceffba08b7484eba80f991681ae857 P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:03.241052 25549 raft_consensus.cc:729] T 08ceffba08b7484eba80f991681ae857 P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33bdee1f95224a3c84634833f7538e28, State: Initialized, Role: FOLLOWER
I20260812 02:43:03.241051 25547 raft_consensus.cc:729] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49eb39a0fcac4ddea84001be6f1f72a4, State: Initialized, Role: FOLLOWER
I20260812 02:43:03.241216 25547 consensus_queue.cc:260] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.241210 25549 consensus_queue.cc:260] T 08ceffba08b7484eba80f991681ae857 P 33bdee1f95224a3c84634833f7538e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.241529 25561 tablet_replica.cc:439] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } } }
I20260812 02:43:03.241675 25561 tablet_replica.cc:442] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 02:43:03.241781 25556 tablet_replica.cc:439] T 08ceffba08b7484eba80f991681ae857 P 33bdee1f95224a3c84634833f7538e28: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } } }
I20260812 02:43:03.241861 25544 tablet_bootstrap.cc:492] T 08ceffba08b7484eba80f991681ae857 P f6cd47af1a7340b498357543e150be3c: No bootstrap required, opened a new log
I20260812 02:43:03.241899 25556 tablet_replica.cc:442] T 08ceffba08b7484eba80f991681ae857 P 33bdee1f95224a3c84634833f7538e28: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 02:43:03.241937 25544 ts_tablet_manager.cc:1397] T 08ceffba08b7484eba80f991681ae857 P f6cd47af1a7340b498357543e150be3c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 02:43:03.241927 25547 ts_tablet_manager.cc:1428] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260812 02:43:03.242424 25544 raft_consensus.cc:348] T 08ceffba08b7484eba80f991681ae857 P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.242532 25544 raft_consensus.cc:374] T 08ceffba08b7484eba80f991681ae857 P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:03.242568 25544 raft_consensus.cc:729] T 08ceffba08b7484eba80f991681ae857 P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6cd47af1a7340b498357543e150be3c, State: Initialized, Role: FOLLOWER
I20260812 02:43:03.242637 25549 ts_tablet_manager.cc:1428] T 08ceffba08b7484eba80f991681ae857 P 33bdee1f95224a3c84634833f7538e28: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 02:43:03.242712 25544 consensus_queue.cc:260] T 08ceffba08b7484eba80f991681ae857 P f6cd47af1a7340b498357543e150be3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.243017 25544 ts_tablet_manager.cc:1428] T 08ceffba08b7484eba80f991681ae857 P f6cd47af1a7340b498357543e150be3c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 02:43:03.242957 25560 tablet_replica.cc:439] T 08ceffba08b7484eba80f991681ae857 P f6cd47af1a7340b498357543e150be3c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } } }
I20260812 02:43:03.243098 25560 tablet_replica.cc:442] T 08ceffba08b7484eba80f991681ae857 P f6cd47af1a7340b498357543e150be3c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 02:43:03.562605 25561 consensus_queue.cc:1035] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:43:03.567269 25561 consensus_queue.cc:1035] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:43:03.570523 25561 raft_consensus.cc:482] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:43:03.570645 25561 raft_consensus.cc:504] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.571046 25561 leader_election.cc:288] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33bdee1f95224a3c84634833f7538e28 (127.10.75.66:33793), f6cd47af1a7340b498357543e150be3c (127.10.75.67:42679)
I20260812 02:43:03.571409 25415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ceffba08b7484eba80f991681ae857" candidate_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6cd47af1a7340b498357543e150be3c" is_pre_election: true
I20260812 02:43:03.571588 25415 raft_consensus.cc:2454] T 08ceffba08b7484eba80f991681ae857 P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49eb39a0fcac4ddea84001be6f1f72a4 in term 0.
I20260812 02:43:03.571883 24771 leader_election.cc:302] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49eb39a0fcac4ddea84001be6f1f72a4, f6cd47af1a7340b498357543e150be3c; no voters:
I20260812 02:43:03.571842 25160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ceffba08b7484eba80f991681ae857" candidate_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33bdee1f95224a3c84634833f7538e28" is_pre_election: true
I20260812 02:43:03.572060 25561 raft_consensus.cc:2781] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:43:03.572120 25561 raft_consensus.cc:482] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:43:03.572171 25561 raft_consensus.cc:3037] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:03.573194 25561 raft_consensus.cc:504] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.573560 25561 leader_election.cc:288] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 [CANDIDATE]: Term 1 election: Requested vote from peers 33bdee1f95224a3c84634833f7538e28 (127.10.75.66:33793), f6cd47af1a7340b498357543e150be3c (127.10.75.67:42679)
I20260812 02:43:03.573683 25160 raft_consensus.cc:2454] T 08ceffba08b7484eba80f991681ae857 P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49eb39a0fcac4ddea84001be6f1f72a4 in term 0.
I20260812 02:43:03.573839 25157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ceffba08b7484eba80f991681ae857" candidate_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33bdee1f95224a3c84634833f7538e28"
I20260812 02:43:03.573973 25157 raft_consensus.cc:3037] T 08ceffba08b7484eba80f991681ae857 P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:03.573961 25415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ceffba08b7484eba80f991681ae857" candidate_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6cd47af1a7340b498357543e150be3c"
I20260812 02:43:03.574091 25415 raft_consensus.cc:3037] T 08ceffba08b7484eba80f991681ae857 P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:03.574987 25157 raft_consensus.cc:2454] T 08ceffba08b7484eba80f991681ae857 P 33bdee1f95224a3c84634833f7538e28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49eb39a0fcac4ddea84001be6f1f72a4 in term 1.
I20260812 02:43:03.574994 25415 raft_consensus.cc:2454] T 08ceffba08b7484eba80f991681ae857 P f6cd47af1a7340b498357543e150be3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49eb39a0fcac4ddea84001be6f1f72a4 in term 1.
I20260812 02:43:03.575343 24771 leader_election.cc:302] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49eb39a0fcac4ddea84001be6f1f72a4, f6cd47af1a7340b498357543e150be3c; no voters:
I20260812 02:43:03.575523 25561 raft_consensus.cc:2781] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:43:03.575623 25561 raft_consensus.cc:686] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 LEADER]: Becoming Leader. State: Replica: 49eb39a0fcac4ddea84001be6f1f72a4, State: Running, Role: LEADER
I20260812 02:43:03.575757 25561 consensus_queue.cc:237] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.576435 25604 tablet_replica.cc:439] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4: TxnStatusTablet state changed. Reason: New leader 49eb39a0fcac4ddea84001be6f1f72a4. Latest consensus state: current_term: 1 leader_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } } }
I20260812 02:43:03.576546 25604 tablet_replica.cc:442] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4: This TxnStatusTablet replica's current role is: LEADER
I20260812 02:43:03.576797 25637 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 02:43:03.576949 25637 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 02:43:03.577415 24586 catalog_manager.cc:5495] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49eb39a0fcac4ddea84001be6f1f72a4 (127.10.75.65). New cstate: current_term: 1 leader_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } health_report { overall_health: UNKNOWN } } }
I20260812 02:43:03.612485 25615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:03.606895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:40317 (local address 127.0.0.1:38846)
0812 02:43:03.607139 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:03.607161 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:03.607320 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:03.608055 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:03.608058 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:03.608067 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 02:43:03.608231 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:03.608237 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.609439 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.609443 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:03.610178 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:03.610188 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.610898 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.610901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:03.610996 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:03.611062 (+ 66us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 02:43:03.612125 (+ 1063us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 02:43:03.612145 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 02:43:03.612213 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 02:43:03.612323 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260812 02:43:03.612538 25644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:03.607154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38846 (local address 127.10.75.65:40317)
0812 02:43:03.607637 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:03.607647 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:03.607665 (+ 18us) server_negotiation.cc:407] Connection header received
0812 02:43:03.607773 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:03.607776 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:03.607863 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:03.607999 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:43:03.608389 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.609303 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.610318 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.610709 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.610824 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:03.611279 (+ 455us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:43:03.612013 (+ 734us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:43:03.612138 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:03.612255 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 02:43:03.612344 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":238,"threads_started":1}
I20260812 02:43:03.616506 25157 raft_consensus.cc:1261] T 08ceffba08b7484eba80f991681ae857 P 33bdee1f95224a3c84634833f7538e28 [term 1 FOLLOWER]: Refusing update from remote peer 49eb39a0fcac4ddea84001be6f1f72a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:43:03.616683 25415 raft_consensus.cc:1261] T 08ceffba08b7484eba80f991681ae857 P f6cd47af1a7340b498357543e150be3c [term 1 FOLLOWER]: Refusing update from remote peer 49eb39a0fcac4ddea84001be6f1f72a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:43:03.617108 25561 consensus_queue.cc:1035] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:43:03.617308 25604 consensus_queue.cc:1035] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:43:03.619036 25560 tablet_replica.cc:439] T 08ceffba08b7484eba80f991681ae857 P f6cd47af1a7340b498357543e150be3c: TxnStatusTablet state changed. Reason: New leader 49eb39a0fcac4ddea84001be6f1f72a4. Latest consensus state: current_term: 1 leader_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } } }
I20260812 02:43:03.619189 25560 tablet_replica.cc:442] T 08ceffba08b7484eba80f991681ae857 P f6cd47af1a7340b498357543e150be3c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 02:43:03.619143 25556 tablet_replica.cc:439] T 08ceffba08b7484eba80f991681ae857 P 33bdee1f95224a3c84634833f7538e28: TxnStatusTablet state changed. Reason: New leader 49eb39a0fcac4ddea84001be6f1f72a4. Latest consensus state: current_term: 1 leader_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } } }
I20260812 02:43:03.619269 25556 tablet_replica.cc:442] T 08ceffba08b7484eba80f991681ae857 P 33bdee1f95224a3c84634833f7538e28: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 02:43:03.621217 25625 mvcc.cc:205] Tried to move back new op lower bound from 7317514582487511040 to 7317514582327615488. Current Snapshot: MvccSnapshot[applied={T|T < 7317514582487511040}]
I20260812 02:43:03.621886 25604 tablet_replica.cc:439] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } } }
I20260812 02:43:03.622042 25604 tablet_replica.cc:442] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4: This TxnStatusTablet replica's current role is: LEADER
I20260812 02:43:03.626328 25561 tablet_replica.cc:439] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } } }
I20260812 02:43:03.626506 25561 tablet_replica.cc:442] T 08ceffba08b7484eba80f991681ae857 P 49eb39a0fcac4ddea84001be6f1f72a4: This TxnStatusTablet replica's current role is: LEADER
I20260812 02:43:03.627221 25556 tablet_replica.cc:439] T 08ceffba08b7484eba80f991681ae857 P 33bdee1f95224a3c84634833f7538e28: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } } }
I20260812 02:43:03.627374 25556 tablet_replica.cc:442] T 08ceffba08b7484eba80f991681ae857 P 33bdee1f95224a3c84634833f7538e28: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 02:43:03.628139 25560 tablet_replica.cc:439] T 08ceffba08b7484eba80f991681ae857 P f6cd47af1a7340b498357543e150be3c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } } }
I20260812 02:43:03.628311 25560 tablet_replica.cc:442] T 08ceffba08b7484eba80f991681ae857 P f6cd47af1a7340b498357543e150be3c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 02:43:03.635857 25644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:03.631042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38852 (local address 127.10.75.65:40317)
0812 02:43:03.631477 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:03.631483 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:03.631838 (+ 355us) server_negotiation.cc:407] Connection header received
0812 02:43:03.631973 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:03.631976 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:03.632032 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:03.632097 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:43:03.632451 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.633019 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.634493 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.634737 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.634847 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:03.635210 (+ 363us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:43:03.635337 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:43:03.635446 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:03.635593 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 02:43:03.635672 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331}
I20260812 02:43:03.650099 25644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:03.645618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:60051 (local address 127.10.75.65:40317)
0812 02:43:03.645795 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:03.645801 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:03.646179 (+ 378us) server_negotiation.cc:407] Connection header received
0812 02:43:03.646335 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:03.646339 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:03.646398 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:03.646485 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:43:03.646780 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.647653 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.648609 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.648963 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.649093 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:03.649447 (+ 354us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:43:03.649560 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:43:03.649633 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:03.649790 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 02:43:03.649847 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":71}
I20260812 02:43:03.650148 25661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:03.645492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:40317 (local address 127.10.75.65:60051)
0812 02:43:03.646017 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:03.646032 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:03.646226 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:03.646503 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:03.646505 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:03.646512 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 02:43:03.646671 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:03.646676 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.647774 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.647777 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:03.648482 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:03.648493 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.649107 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.649110 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:03.649184 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:03.649273 (+ 89us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 02:43:03.649670 (+ 397us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 02:43:03.649676 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 02:43:03.649738 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 02:43:03.649812 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"mutex_wait_us":19,"thread_start_us":238,"threads_started":1}
I20260812 02:43:03.702937 24586 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:43:03.703197 24586 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:43:03.705806 24586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0: Sending DeleteTablet for 3 replicas of tablet 6f13c487416642f09bacda61986cb255
I20260812 02:43:03.706521 24856 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f13c487416642f09bacda61986cb255 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:43:03 UTC) from {username='oryx', principal='oryx/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:38830
I20260812 02:43:03.707001 25122 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f13c487416642f09bacda61986cb255 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:43:03 UTC) from {username='oryx', principal='oryx/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:34804
I20260812 02:43:03.707442 25385 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f13c487416642f09bacda61986cb255 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:43:03 UTC) from {username='oryx', principal='oryx/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:52146
I20260812 02:43:03.707628 25664 tablet_replica.cc:330] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28: stopping tablet replica
I20260812 02:43:03.707829 25664 raft_consensus.cc:2229] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:43:03.707993 25664 raft_consensus.cc:2258] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:43:03.708073 25663 tablet_replica.cc:330] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4: stopping tablet replica
I20260812 02:43:03.708578 25663 raft_consensus.cc:2229] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:43:03.708957 25663 raft_consensus.cc:2258] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:43:03.709771 25664 ts_tablet_manager.cc:1905] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:43:03.709770 25663 ts_tablet_manager.cc:1905] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:43:03.712908 25665 tablet_replica.cc:330] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c: stopping tablet replica
I20260812 02:43:03.713071 25665 raft_consensus.cc:2229] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:43:03.713218 25665 raft_consensus.cc:2258] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:43:03.713711 25664 ts_tablet_manager.cc:1918] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 02:43:03.713809 25664 log.cc:1196] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/6f13c487416642f09bacda61986cb255
I20260812 02:43:03.714195 25664 ts_tablet_manager.cc:1939] T 6f13c487416642f09bacda61986cb255 P 33bdee1f95224a3c84634833f7538e28: Deleting consensus metadata
I20260812 02:43:03.714440 25663 ts_tablet_manager.cc:1918] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 02:43:03.714609 25663 log.cc:1196] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/wal/wals/6f13c487416642f09bacda61986cb255
I20260812 02:43:03.715004 25663 ts_tablet_manager.cc:1939] T 6f13c487416642f09bacda61986cb255 P 49eb39a0fcac4ddea84001be6f1f72a4: Deleting consensus metadata
I20260812 02:43:03.715281 24568 catalog_manager.cc:4841] TS 33bdee1f95224a3c84634833f7538e28 (127.10.75.66:33793): tablet 6f13c487416642f09bacda61986cb255 (table test-table [id=cef29385f76d4d08b9dfe0aec44d5f69]) successfully deleted
I20260812 02:43:03.715442 25665 ts_tablet_manager.cc:1905] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:43:03.716107 24568 catalog_manager.cc:4841] TS 49eb39a0fcac4ddea84001be6f1f72a4 (127.10.75.65:40317): tablet 6f13c487416642f09bacda61986cb255 (table test-table [id=cef29385f76d4d08b9dfe0aec44d5f69]) successfully deleted
I20260812 02:43:03.718127 25665 ts_tablet_manager.cc:1918] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 02:43:03.718214 25665 log.cc:1196] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/6f13c487416642f09bacda61986cb255
I20260812 02:43:03.718479 25665 ts_tablet_manager.cc:1939] T 6f13c487416642f09bacda61986cb255 P f6cd47af1a7340b498357543e150be3c: Deleting consensus metadata
I20260812 02:43:03.719218 24568 catalog_manager.cc:4841] TS f6cd47af1a7340b498357543e150be3c (127.10.75.67:42679): tablet 6f13c487416642f09bacda61986cb255 (table test-table [id=cef29385f76d4d08b9dfe0aec44d5f69]) successfully deleted
Aug 12 02:43:03 dist-test-slave-2p8l krb5kdc[24514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 02:43:03 dist-test-slave-2p8l krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:03 dist-test-slave-2p8l krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 02:43:03.753635 25684 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:03.740762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51742 (local address 127.10.75.126:38387)
0812 02:43:03.741167 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:03.741174 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:03.741193 (+ 19us) server_negotiation.cc:407] Connection header received
0812 02:43:03.741334 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:03.741338 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:03.741398 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:03.741515 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:03.742440 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.743395 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.744404 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.744812 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.744945 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:03.753399 (+ 8454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51742: BlockingRecv error: recv got EOF from 127.0.0.1:51742 (error 108)
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":127,"threads_started":1}
Aug 12 02:43:03 dist-test-slave-2p8l krb5kdc[24514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM
I20260812 02:43:03.766407 25684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:03.755575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51746 (local address 127.10.75.126:38387)
0812 02:43:03.755739 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:03.755744 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:03.755889 (+ 145us) server_negotiation.cc:407] Connection header received
0812 02:43:03.756136 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:03.756138 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:03.756193 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:03.756270 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:03.757073 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.757650 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.758818 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.759051 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.759145 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:03.762385 (+ 3240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:03.762394 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:03.762396 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:03.762425 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:03.764145 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:03.764708 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:03.764712 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:03.764713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:03.764802 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:03.765157 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:03.765160 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:03.765161 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:03.765442 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:03.765566 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:03.765900 (+ 334us) server_negotiation.cc:299] Negotiation successful
0812 02:43:03.766159 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 02:43:03.769915 24586 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51746:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:43:03.770700 24586 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:43:03.777091 25385 tablet_service.cc:1467] Processing CreateTablet for tablet cd0066826c4c4c779fa6f4b864f6d66f (DEFAULT_TABLE table=test-table [id=223d0ce5e6ea48ebb27a20448ed6a726]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:43:03.777066 24856 tablet_service.cc:1467] Processing CreateTablet for tablet cd0066826c4c4c779fa6f4b864f6d66f (DEFAULT_TABLE table=test-table [id=223d0ce5e6ea48ebb27a20448ed6a726]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:43:03.777143 25122 tablet_service.cc:1467] Processing CreateTablet for tablet cd0066826c4c4c779fa6f4b864f6d66f (DEFAULT_TABLE table=test-table [id=223d0ce5e6ea48ebb27a20448ed6a726]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:43:03.777494 25122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd0066826c4c4c779fa6f4b864f6d66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:03.777503 24856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd0066826c4c4c779fa6f4b864f6d66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:03.777496 25385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd0066826c4c4c779fa6f4b864f6d66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:03.780920 25695 tablet_bootstrap.cc:492] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4: Bootstrap starting.
I20260812 02:43:03.782105 25697 tablet_bootstrap.cc:492] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28: Bootstrap starting.
I20260812 02:43:03.782127 25695 tablet_bootstrap.cc:654] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:03.782866 25696 tablet_bootstrap.cc:492] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c: Bootstrap starting.
I20260812 02:43:03.783273 25697 tablet_bootstrap.cc:654] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:03.784343 25695 tablet_bootstrap.cc:492] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4: No bootstrap required, opened a new log
I20260812 02:43:03.784466 25695 ts_tablet_manager.cc:1397] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 02:43:03.784976 25695 raft_consensus.cc:348] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.785127 25695 raft_consensus.cc:374] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:03.785172 25695 raft_consensus.cc:729] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49eb39a0fcac4ddea84001be6f1f72a4, State: Initialized, Role: FOLLOWER
I20260812 02:43:03.785319 25695 consensus_queue.cc:260] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.785636 25695 ts_tablet_manager.cc:1428] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 02:43:03.785925 25696 tablet_bootstrap.cc:654] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:03.786928 25697 tablet_bootstrap.cc:492] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28: No bootstrap required, opened a new log
I20260812 02:43:03.787050 25697 ts_tablet_manager.cc:1397] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260812 02:43:03.787590 25697 raft_consensus.cc:348] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.787731 25697 raft_consensus.cc:374] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:03.787772 25697 raft_consensus.cc:729] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33bdee1f95224a3c84634833f7538e28, State: Initialized, Role: FOLLOWER
I20260812 02:43:03.787928 25697 consensus_queue.cc:260] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.788234 25697 ts_tablet_manager.cc:1428] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 02:43:03.790339 25696 tablet_bootstrap.cc:492] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c: No bootstrap required, opened a new log
I20260812 02:43:03.790516 25696 ts_tablet_manager.cc:1397] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260812 02:43:03.791172 25696 raft_consensus.cc:348] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.791386 25696 raft_consensus.cc:374] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:03.791469 25696 raft_consensus.cc:729] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6cd47af1a7340b498357543e150be3c, State: Initialized, Role: FOLLOWER
I20260812 02:43:03.791702 25696 consensus_queue.cc:260] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.792584 25696 ts_tablet_manager.cc:1428] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 02:43:03.838378 25560 raft_consensus.cc:482] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:43:03.838591 25560 raft_consensus.cc:504] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.840236 25560 leader_election.cc:288] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49eb39a0fcac4ddea84001be6f1f72a4 (127.10.75.65:40317), 33bdee1f95224a3c84634833f7538e28 (127.10.75.66:33793)
I20260812 02:43:03.846125 25702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:03.840535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:40317 (local address 127.10.75.67:51877)
0812 02:43:03.841091 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:03.841108 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:03.841342 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:03.841884 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:03.841887 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:03.841911 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:43:03.842123 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:03.842134 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.843205 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.843209 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:03.844663 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:03.844675 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.845508 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.845513 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:03.845621 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:03.845657 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 02:43:03.845773 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 02:43:03.845871 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"mutex_wait_us":28,"thread_start_us":209,"threads_started":1}
I20260812 02:43:03.846094 25644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:03.840676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:51877 (local address 127.10.75.65:40317)
0812 02:43:03.840886 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:03.840894 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:03.841202 (+ 308us) server_negotiation.cc:407] Connection header received
0812 02:43:03.841519 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:03.841524 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:03.841611 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:03.841673 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:43:03.842315 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.842993 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.844834 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.845334 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.845526 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:03.845611 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:03.845805 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 02:43:03.845911 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260812 02:43:03.846863 24900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd0066826c4c4c779fa6f4b864f6d66f" candidate_uuid: "f6cd47af1a7340b498357543e150be3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" is_pre_election: true
I20260812 02:43:03.847100 24900 raft_consensus.cc:2454] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6cd47af1a7340b498357543e150be3c in term 0.
I20260812 02:43:03.847656 25292 leader_election.cc:302] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49eb39a0fcac4ddea84001be6f1f72a4, f6cd47af1a7340b498357543e150be3c; no voters:
I20260812 02:43:03.847921 25705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:03.841103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:33793 (local address 127.10.75.67:42549)
0812 02:43:03.841527 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:03.841542 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:03.841639 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:03.842281 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:03.842285 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:03.842314 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:43:03.842997 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:03.843009 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.844337 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.844341 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:03.845676 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:03.845689 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.847455 (+ 1766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.847460 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:03.847568 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:03.847598 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 02:43:03.847654 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 02:43:03.847730 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":53,"thread_start_us":153,"threads_started":1}
I20260812 02:43:03.848098 25560 raft_consensus.cc:2781] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:43:03.848179 25560 raft_consensus.cc:482] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:43:03.848230 25560 raft_consensus.cc:3037] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:03.848702 25706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:03.841331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:42549 (local address 127.10.75.66:33793)
0812 02:43:03.841920 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:03.841926 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:03.841941 (+ 15us) server_negotiation.cc:407] Connection header received
0812 02:43:03.842005 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:03.842009 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:03.842112 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:03.842228 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:43:03.843206 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.844128 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.845870 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.847258 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.848329 (+ 1071us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:03.848402 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:03.848447 (+ 45us) server_negotiation.cc:299] Negotiation successful
0812 02:43:03.848537 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":108,"threads_started":1}
I20260812 02:43:03.849408 25157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd0066826c4c4c779fa6f4b864f6d66f" candidate_uuid: "f6cd47af1a7340b498357543e150be3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33bdee1f95224a3c84634833f7538e28" is_pre_election: true
I20260812 02:43:03.849614 25157 raft_consensus.cc:2454] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6cd47af1a7340b498357543e150be3c in term 0.
I20260812 02:43:03.850152 25560 raft_consensus.cc:504] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.850649 25560 leader_election.cc:288] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [CANDIDATE]: Term 1 election: Requested vote from peers 49eb39a0fcac4ddea84001be6f1f72a4 (127.10.75.65:40317), 33bdee1f95224a3c84634833f7538e28 (127.10.75.66:33793)
I20260812 02:43:03.851154 25157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd0066826c4c4c779fa6f4b864f6d66f" candidate_uuid: "f6cd47af1a7340b498357543e150be3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33bdee1f95224a3c84634833f7538e28"
I20260812 02:43:03.851154 24900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd0066826c4c4c779fa6f4b864f6d66f" candidate_uuid: "f6cd47af1a7340b498357543e150be3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49eb39a0fcac4ddea84001be6f1f72a4"
I20260812 02:43:03.851321 25157 raft_consensus.cc:3037] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:03.851321 24900 raft_consensus.cc:3037] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:03.852900 25157 raft_consensus.cc:2454] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6cd47af1a7340b498357543e150be3c in term 1.
I20260812 02:43:03.852900 24900 raft_consensus.cc:2454] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6cd47af1a7340b498357543e150be3c in term 1.
I20260812 02:43:03.853319 25292 leader_election.cc:302] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49eb39a0fcac4ddea84001be6f1f72a4, f6cd47af1a7340b498357543e150be3c; no voters:
I20260812 02:43:03.853586 25560 raft_consensus.cc:2781] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:43:03.853927 25560 raft_consensus.cc:686] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [term 1 LEADER]: Becoming Leader. State: Replica: f6cd47af1a7340b498357543e150be3c, State: Running, Role: LEADER
I20260812 02:43:03.854329 25560 consensus_queue.cc:237] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.857793 24585 catalog_manager.cc:5495] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c reported cstate change: term changed from 0 to 1, leader changed from <none> to f6cd47af1a7340b498357543e150be3c (127.10.75.67). New cstate: current_term: 1 leader_uuid: "f6cd47af1a7340b498357543e150be3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } health_report { overall_health: HEALTHY } } }
I20260812 02:43:03.873633 25715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:03.869083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52154 (local address 127.10.75.67:42679)
0812 02:43:03.869456 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:03.869464 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:03.869478 (+ 14us) server_negotiation.cc:407] Connection header received
0812 02:43:03.869574 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:03.869577 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:03.869644 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:03.869812 (+ 168us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:43:03.870139 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.870822 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.871769 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:03.872050 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:03.872177 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:03.872483 (+ 306us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:43:03.873169 (+ 686us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:43:03.873327 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:03.873367 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 02:43:03.873433 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":196,"threads_started":1}
I20260812 02:43:03.877128 24900 raft_consensus.cc:1261] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 FOLLOWER]: Refusing update from remote peer f6cd47af1a7340b498357543e150be3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:43:03.877156 25157 raft_consensus.cc:1261] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28 [term 1 FOLLOWER]: Refusing update from remote peer f6cd47af1a7340b498357543e150be3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:43:03.877847 25707 consensus_queue.cc:1035] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:43:03.878144 25560 consensus_queue.cc:1035] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:43:03.894824 24586 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51746:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:43:03.895057 24586 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51746:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:43:03.897970 24586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0: Sending DeleteTablet for 3 replicas of tablet cd0066826c4c4c779fa6f4b864f6d66f
I20260812 02:43:03.898854 25122 tablet_service.cc:1514] Processing DeleteTablet for tablet cd0066826c4c4c779fa6f4b864f6d66f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:43:03 UTC) from {username='oryx', principal='oryx/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:34804
I20260812 02:43:03.898948 24856 tablet_service.cc:1514] Processing DeleteTablet for tablet cd0066826c4c4c779fa6f4b864f6d66f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:43:03 UTC) from {username='oryx', principal='oryx/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:38830
I20260812 02:43:03.899143 25664 tablet_replica.cc:330] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28: stopping tablet replica
I20260812 02:43:03.899199 25663 tablet_replica.cc:330] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4: stopping tablet replica
I20260812 02:43:03.899325 25663 raft_consensus.cc:2229] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:43:03.899327 25664 raft_consensus.cc:2229] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:43:03.899492 25663 raft_consensus.cc:2258] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:43:03.899490 25664 raft_consensus.cc:2258] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:43:03.899705 25385 tablet_service.cc:1514] Processing DeleteTablet for tablet cd0066826c4c4c779fa6f4b864f6d66f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:43:03 UTC) from {username='oryx', principal='oryx/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:52146
I20260812 02:43:03.900075 25665 tablet_replica.cc:330] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c: stopping tablet replica
I20260812 02:43:03.900244 25665 raft_consensus.cc:2229] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:43:03.900508 25663 ts_tablet_manager.cc:1905] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:43:03.900736 25665 raft_consensus.cc:2258] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:43:03.901597 25664 ts_tablet_manager.cc:1905] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:43:03.903796 25663 ts_tablet_manager.cc:1918] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:43:03.903903 25663 log.cc:1196] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-0/wal/wals/cd0066826c4c4c779fa6f4b864f6d66f
I20260812 02:43:03.904189 25663 ts_tablet_manager.cc:1939] T cd0066826c4c4c779fa6f4b864f6d66f P 49eb39a0fcac4ddea84001be6f1f72a4: Deleting consensus metadata
I20260812 02:43:03.904979 25664 ts_tablet_manager.cc:1918] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:43:03.905092 25664 log.cc:1196] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/cd0066826c4c4c779fa6f4b864f6d66f
I20260812 02:43:03.905416 25664 ts_tablet_manager.cc:1939] T cd0066826c4c4c779fa6f4b864f6d66f P 33bdee1f95224a3c84634833f7538e28: Deleting consensus metadata
I20260812 02:43:03.905357 24568 catalog_manager.cc:4841] TS 49eb39a0fcac4ddea84001be6f1f72a4 (127.10.75.65:40317): tablet cd0066826c4c4c779fa6f4b864f6d66f (table test-table [id=223d0ce5e6ea48ebb27a20448ed6a726]) successfully deleted
I20260812 02:43:03.906385 24568 catalog_manager.cc:4841] TS 33bdee1f95224a3c84634833f7538e28 (127.10.75.66:33793): tablet cd0066826c4c4c779fa6f4b864f6d66f (table test-table [id=223d0ce5e6ea48ebb27a20448ed6a726]) successfully deleted
I20260812 02:43:03.907538 24586 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51746:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 02:43:03.907985 25665 ts_tablet_manager.cc:1905] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 02:43:03.908219 24586 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:43:03.911403 25665 ts_tablet_manager.cc:1918] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:43:03.911532 25665 log.cc:1196] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/cd0066826c4c4c779fa6f4b864f6d66f
I20260812 02:43:03.911847 25665 ts_tablet_manager.cc:1939] T cd0066826c4c4c779fa6f4b864f6d66f P f6cd47af1a7340b498357543e150be3c: Deleting consensus metadata
I20260812 02:43:03.913578 24568 catalog_manager.cc:4841] TS f6cd47af1a7340b498357543e150be3c (127.10.75.67:42679): tablet cd0066826c4c4c779fa6f4b864f6d66f (table test-table [id=223d0ce5e6ea48ebb27a20448ed6a726]) successfully deleted
I20260812 02:43:03.915416 25122 tablet_service.cc:1467] Processing CreateTablet for tablet e92eaf7fae3e43b38ed4079c2d13975a (DEFAULT_TABLE table=test-table [id=00c1d5e094364a589053011e1d9e0a24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:43:03.915639 24856 tablet_service.cc:1467] Processing CreateTablet for tablet e92eaf7fae3e43b38ed4079c2d13975a (DEFAULT_TABLE table=test-table [id=00c1d5e094364a589053011e1d9e0a24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:43:03.915846 25122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e92eaf7fae3e43b38ed4079c2d13975a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:03.915992 24856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e92eaf7fae3e43b38ed4079c2d13975a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:03.918433 25385 tablet_service.cc:1467] Processing CreateTablet for tablet e92eaf7fae3e43b38ed4079c2d13975a (DEFAULT_TABLE table=test-table [id=00c1d5e094364a589053011e1d9e0a24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:43:03.918810 25385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e92eaf7fae3e43b38ed4079c2d13975a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:03.919453 25695 tablet_bootstrap.cc:492] T e92eaf7fae3e43b38ed4079c2d13975a P 49eb39a0fcac4ddea84001be6f1f72a4: Bootstrap starting.
I20260812 02:43:03.920634 25695 tablet_bootstrap.cc:654] T e92eaf7fae3e43b38ed4079c2d13975a P 49eb39a0fcac4ddea84001be6f1f72a4: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:03.922163 25696 tablet_bootstrap.cc:492] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c: Bootstrap starting.
I20260812 02:43:03.923003 25697 tablet_bootstrap.cc:492] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28: Bootstrap starting.
I20260812 02:43:03.924077 25697 tablet_bootstrap.cc:654] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:03.924652 25695 tablet_bootstrap.cc:492] T e92eaf7fae3e43b38ed4079c2d13975a P 49eb39a0fcac4ddea84001be6f1f72a4: No bootstrap required, opened a new log
I20260812 02:43:03.924851 25695 ts_tablet_manager.cc:1397] T e92eaf7fae3e43b38ed4079c2d13975a P 49eb39a0fcac4ddea84001be6f1f72a4: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 02:43:03.925448 25695 raft_consensus.cc:348] T e92eaf7fae3e43b38ed4079c2d13975a P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.925595 25695 raft_consensus.cc:374] T e92eaf7fae3e43b38ed4079c2d13975a P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:03.925638 25695 raft_consensus.cc:729] T e92eaf7fae3e43b38ed4079c2d13975a P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49eb39a0fcac4ddea84001be6f1f72a4, State: Initialized, Role: FOLLOWER
I20260812 02:43:03.925814 25695 consensus_queue.cc:260] T e92eaf7fae3e43b38ed4079c2d13975a P 49eb39a0fcac4ddea84001be6f1f72a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.926783 25695 ts_tablet_manager.cc:1428] T e92eaf7fae3e43b38ed4079c2d13975a P 49eb39a0fcac4ddea84001be6f1f72a4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 02:43:03.927176 25696 tablet_bootstrap.cc:654] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:03.928926 25697 tablet_bootstrap.cc:492] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28: No bootstrap required, opened a new log
I20260812 02:43:03.929081 25697 ts_tablet_manager.cc:1397] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260812 02:43:03.929176 25696 tablet_bootstrap.cc:492] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c: No bootstrap required, opened a new log
I20260812 02:43:03.929297 25696 ts_tablet_manager.cc:1397] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260812 02:43:03.929638 25697 raft_consensus.cc:348] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.929818 25697 raft_consensus.cc:374] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:03.929862 25697 raft_consensus.cc:729] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33bdee1f95224a3c84634833f7538e28, State: Initialized, Role: FOLLOWER
I20260812 02:43:03.929872 25696 raft_consensus.cc:348] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.930034 25697 consensus_queue.cc:260] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.930133 25696 raft_consensus.cc:374] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:03.930176 25696 raft_consensus.cc:729] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6cd47af1a7340b498357543e150be3c, State: Initialized, Role: FOLLOWER
I20260812 02:43:03.930401 25697 ts_tablet_manager.cc:1428] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260812 02:43:03.930371 25696 consensus_queue.cc:260] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:03.931371 25696 ts_tablet_manager.cc:1428] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 02:43:04.192847 25556 raft_consensus.cc:482] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:43:04.193065 25556 raft_consensus.cc:504] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:04.193565 25556 leader_election.cc:288] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49eb39a0fcac4ddea84001be6f1f72a4 (127.10.75.65:40317), f6cd47af1a7340b498357543e150be3c (127.10.75.67:42679)
I20260812 02:43:04.194381 25416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92eaf7fae3e43b38ed4079c2d13975a" candidate_uuid: "33bdee1f95224a3c84634833f7538e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6cd47af1a7340b498357543e150be3c" is_pre_election: true
I20260812 02:43:04.194372 24900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92eaf7fae3e43b38ed4079c2d13975a" candidate_uuid: "33bdee1f95224a3c84634833f7538e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" is_pre_election: true
I20260812 02:43:04.194607 24900 raft_consensus.cc:2454] T e92eaf7fae3e43b38ed4079c2d13975a P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33bdee1f95224a3c84634833f7538e28 in term 0.
I20260812 02:43:04.194607 25416 raft_consensus.cc:2454] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33bdee1f95224a3c84634833f7538e28 in term 0.
I20260812 02:43:04.195029 25032 leader_election.cc:302] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33bdee1f95224a3c84634833f7538e28, 49eb39a0fcac4ddea84001be6f1f72a4; no voters:
I20260812 02:43:04.195290 25556 raft_consensus.cc:2781] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:43:04.195356 25556 raft_consensus.cc:482] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:43:04.195385 25556 raft_consensus.cc:3037] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:04.196707 25556 raft_consensus.cc:504] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:04.197105 25556 leader_election.cc:288] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [CANDIDATE]: Term 1 election: Requested vote from peers 49eb39a0fcac4ddea84001be6f1f72a4 (127.10.75.65:40317), f6cd47af1a7340b498357543e150be3c (127.10.75.67:42679)
I20260812 02:43:04.197584 24900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92eaf7fae3e43b38ed4079c2d13975a" candidate_uuid: "33bdee1f95224a3c84634833f7538e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49eb39a0fcac4ddea84001be6f1f72a4"
I20260812 02:43:04.197633 25416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e92eaf7fae3e43b38ed4079c2d13975a" candidate_uuid: "33bdee1f95224a3c84634833f7538e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6cd47af1a7340b498357543e150be3c"
I20260812 02:43:04.197749 24900 raft_consensus.cc:3037] T e92eaf7fae3e43b38ed4079c2d13975a P 49eb39a0fcac4ddea84001be6f1f72a4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:04.197785 25416 raft_consensus.cc:3037] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:04.198994 25416 raft_consensus.cc:2454] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33bdee1f95224a3c84634833f7538e28 in term 1.
I20260812 02:43:04.199047 24900 raft_consensus.cc:2454] T e92eaf7fae3e43b38ed4079c2d13975a P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33bdee1f95224a3c84634833f7538e28 in term 1.
I20260812 02:43:04.199352 25032 leader_election.cc:302] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33bdee1f95224a3c84634833f7538e28, f6cd47af1a7340b498357543e150be3c; no voters:
I20260812 02:43:04.199595 25556 raft_consensus.cc:2781] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:43:04.199826 25556 raft_consensus.cc:686] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [term 1 LEADER]: Becoming Leader. State: Replica: 33bdee1f95224a3c84634833f7538e28, State: Running, Role: LEADER
I20260812 02:43:04.200269 25556 consensus_queue.cc:237] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } }
I20260812 02:43:04.202652 24585 catalog_manager.cc:5495] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33bdee1f95224a3c84634833f7538e28 (127.10.75.66). New cstate: current_term: 1 leader_uuid: "33bdee1f95224a3c84634833f7538e28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33bdee1f95224a3c84634833f7538e28" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 } health_report { overall_health: UNKNOWN } } }
I20260812 02:43:04.250936 25706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:04.247371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34810 (local address 127.10.75.66:33793)
0812 02:43:04.247519 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:04.247524 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:04.247543 (+ 19us) server_negotiation.cc:407] Connection header received
0812 02:43:04.247619 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:04.247623 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:04.247691 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:04.247785 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:43:04.248081 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:04.248661 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:04.249690 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:04.249992 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:04.250151 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:04.250447 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:43:04.250539 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:43:04.250631 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:04.250698 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 02:43:04.250759 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 02:43:04.264983 25737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:04.260315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:40317 (local address 127.10.75.66:51871)
0812 02:43:04.260821 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:04.260836 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:04.261022 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:04.261361 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:04.261364 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:04.261373 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 02:43:04.261522 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:04.261528 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:04.262442 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:04.262447 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:04.263547 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:04.263563 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:04.264072 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:04.264075 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:04.264170 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:04.264238 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 02:43:04.264627 (+ 389us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 02:43:04.264636 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 02:43:04.264706 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 02:43:04.264807 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":236,"threads_started":1}
I20260812 02:43:04.264976 25644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:04.260538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:51871 (local address 127.10.75.65:40317)
0812 02:43:04.260742 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:04.260749 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:04.260928 (+ 179us) server_negotiation.cc:407] Connection header received
0812 02:43:04.261173 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:04.261176 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:04.261243 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:04.261345 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:43:04.261642 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:04.262304 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:04.263688 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:04.263943 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:04.264064 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:04.264403 (+ 339us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:43:04.264528 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:43:04.264620 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:04.264717 (+ 97us) server_negotiation.cc:299] Negotiation successful
0812 02:43:04.264787 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 02:43:04.272656 25416 raft_consensus.cc:1261] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c [term 1 FOLLOWER]: Refusing update from remote peer 33bdee1f95224a3c84634833f7538e28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:43:04.272753 24900 raft_consensus.cc:1261] T e92eaf7fae3e43b38ed4079c2d13975a P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 FOLLOWER]: Refusing update from remote peer 33bdee1f95224a3c84634833f7538e28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:43:04.273212 25556 consensus_queue.cc:1035] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49eb39a0fcac4ddea84001be6f1f72a4" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 40317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:43:04.273445 25725 consensus_queue.cc:1035] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6cd47af1a7340b498357543e150be3c" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:43:04.293175 25741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:04.289226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:33793 (local address 127.10.75.65:39413)
0812 02:43:04.289598 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:04.289613 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:04.289720 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:04.289977 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:04.289980 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:04.289991 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 02:43:04.290161 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:04.290171 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:04.290981 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:04.290987 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:04.291675 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:04.291686 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:04.292269 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:04.292274 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:04.292380 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:04.292425 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 02:43:04.292746 (+ 321us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 02:43:04.292758 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 02:43:04.292830 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 02:43:04.292978 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":178,"threads_started":1}
I20260812 02:43:04.293154 25706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:04.289343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:39413 (local address 127.10.75.66:33793)
0812 02:43:04.289512 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:04.289517 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:04.289703 (+ 186us) server_negotiation.cc:407] Connection header received
0812 02:43:04.289815 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:04.289821 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:04.289887 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:04.289966 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:43:04.290269 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:04.290846 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:04.291827 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:04.292114 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:04.292240 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:04.292567 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:43:04.292651 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:43:04.292741 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:04.292909 (+ 168us) server_negotiation.cc:299] Negotiation successful
0812 02:43:04.292970 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 02:43:04.316061 24586 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51746:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:43:04.316323 24586 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51746:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:43:04.318964 24586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d64368a582174781bc2cb9ae932c96f0: Sending DeleteTablet for 3 replicas of tablet e92eaf7fae3e43b38ed4079c2d13975a
I20260812 02:43:04.319802 25122 tablet_service.cc:1514] Processing DeleteTablet for tablet e92eaf7fae3e43b38ed4079c2d13975a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:43:04 UTC) from {username='oryx', principal='oryx/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:34804
I20260812 02:43:04.319864 25385 tablet_service.cc:1514] Processing DeleteTablet for tablet e92eaf7fae3e43b38ed4079c2d13975a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:43:04 UTC) from {username='oryx', principal='oryx/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:52146
I20260812 02:43:04.320072 25664 tablet_replica.cc:330] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28: stopping tablet replica
I20260812 02:43:04.320151 25665 tablet_replica.cc:330] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c: stopping tablet replica
I20260812 02:43:04.320231 25664 raft_consensus.cc:2229] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:43:04.320194 24856 tablet_service.cc:1514] Processing DeleteTablet for tablet e92eaf7fae3e43b38ed4079c2d13975a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:43:04 UTC) from {username='oryx', principal='oryx/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:38830
I20260812 02:43:04.320274 25665 raft_consensus.cc:2229] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:43:04.320429 25665 raft_consensus.cc:2258] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:43:04.320451 25663 tablet_replica.cc:330] T e92eaf7fae3e43b38ed4079c2d13975a P 49eb39a0fcac4ddea84001be6f1f72a4: stopping tablet replica
I20260812 02:43:04.320467 25664 raft_consensus.cc:2258] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:43:04.320598 25663 raft_consensus.cc:2229] T e92eaf7fae3e43b38ed4079c2d13975a P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:43:04.320741 25663 raft_consensus.cc:2258] T e92eaf7fae3e43b38ed4079c2d13975a P 49eb39a0fcac4ddea84001be6f1f72a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:43:04.320994 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 24728
I20260812 02:43:04.321439 25664 ts_tablet_manager.cc:1905] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:43:04.321579 25665 ts_tablet_manager.cc:1905] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:43:04.329877 25664 ts_tablet_manager.cc:1918] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 02:43:04.330101 25664 log.cc:1196] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/e92eaf7fae3e43b38ed4079c2d13975a
I20260812 02:43:04.330489 25664 ts_tablet_manager.cc:1939] T e92eaf7fae3e43b38ed4079c2d13975a P 33bdee1f95224a3c84634833f7538e28: Deleting consensus metadata
I20260812 02:43:04.331840 24568 catalog_manager.cc:4841] TS 33bdee1f95224a3c84634833f7538e28 (127.10.75.66:33793): tablet e92eaf7fae3e43b38ed4079c2d13975a (table test-table [id=00c1d5e094364a589053011e1d9e0a24]) successfully deleted
I20260812 02:43:04.332037 25665 ts_tablet_manager.cc:1918] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 02:43:04.332161 25665 log.cc:1196] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/e92eaf7fae3e43b38ed4079c2d13975a
I20260812 02:43:04.332414 25665 ts_tablet_manager.cc:1939] T e92eaf7fae3e43b38ed4079c2d13975a P f6cd47af1a7340b498357543e150be3c: Deleting consensus metadata
I20260812 02:43:04.334046 24568 catalog_manager.cc:4841] TS f6cd47af1a7340b498357543e150be3c (127.10.75.67:42679): tablet e92eaf7fae3e43b38ed4079c2d13975a (table test-table [id=00c1d5e094364a589053011e1d9e0a24]) successfully deleted
W20260812 02:43:04.342692 24568 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.75.65:40317 (error 108)
I20260812 02:43:04.342990 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 25005
I20260812 02:43:04.366153 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:04.364261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:40317 (local address 127.0.0.1:38868)
0812 02:43:04.365820 (+ 1559us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:04.365947 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.65:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1424,"thread_start_us":1291,"threads_started":1}
W20260812 02:43:04.366341 24568 catalog_manager.cc:4584] TS 49eb39a0fcac4ddea84001be6f1f72a4 (127.10.75.65:40317): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e92eaf7fae3e43b38ed4079c2d13975a: Network error: Client connection negotiation failed: client connection to 127.10.75.65:40317: connect: Connection refused (error 111)
I20260812 02:43:04.376327 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 25263
I20260812 02:43:04.395376 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 24539
2026-08-12T02:43:04Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (4246 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:43:04 dist-test-slave-2p8l krb5kdc[25756](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:43:04 dist-test-slave-2p8l krb5kdc[25756](info): set up 2 sockets
Aug 12 02:43:04 dist-test-slave-2p8l krb5kdc[25756](info): commencing operation
krb5kdc: starting...
W20260812 02:43:05.826023 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.389s user 0.001s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:43:05 dist-test-slave-2p8l krb5kdc[25756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:43:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:43:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:43:05.959434 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:39331
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:37989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:39331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:43:06.077598 25781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:06.077919 25781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:06.077998 25781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:06.082163 25781 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:43:06.082216 25781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:06.082235 25781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:06.082269 25781 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:43:06.082301 25781 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:43:06.087586 25781 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:37989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:39331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:39331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25781
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:06.088635 25781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:06.089659 25781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:06.097848 25792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:06.097848 25795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:06.097839 25789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:06.098107 25781 server_base.cc:1034] running on GCE node
I20260812 02:43:06.098738 25781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:06.099779 25781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:06.100970 25781 hybrid_clock.cc:648] HybridClock initialized: now 1786502586100957 us; error 33 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T02:43:06Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1704 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:43:06 dist-test-slave-2p8l krb5kdc[25806](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:43:06 dist-test-slave-2p8l krb5kdc[25806](info): set up 2 sockets
Aug 12 02:43:06 dist-test-slave-2p8l krb5kdc[25806](info): commencing operation
krb5kdc: starting...
W20260812 02:43:07.438781 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.298s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:43:07 dist-test-slave-2p8l krb5kdc[25806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:43:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:43:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:43:07.565850 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:34243
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:40611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:34243
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:43:07.678725 25833 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:07.679004 25833 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:07.679081 25833 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:07.683204 25833 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:43:07.683290 25833 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:07.683328 25833 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:07.683390 25833 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:43:07.683429 25833 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:43:07.689256 25833 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:40611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:34243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:34243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25833
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:07.690316 25833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:07.691329 25833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:07.699724 25841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:07.699776 25846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:07.699940 25833 server_base.cc:1034] running on GCE node
W20260812 02:43:07.699743 25842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:07.700729 25833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:07.701753 25833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:07.702955 25833 hybrid_clock.cc:648] HybridClock initialized: now 1786502587702927 us; error 41 us; skew 500 ppm
Aug 12 02:43:07 dist-test-slave-2p8l krb5kdc[25806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502587, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:43:07.705819 25833 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:43:07.706713 25833 webserver.cc:460] Webserver started at http://127.10.75.126:37697/ using document root <none> and password file <none>
I20260812 02:43:07.707278 25833 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:07.707376 25833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:07.707609 25833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:07.709573 25833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "cdabb57f3f0049ffaa9b31a58977414e"
format_stamp: "Formatted at 2026-08-12 02:43:07 on dist-test-slave-2p8l"
server_key: "d903f88e42583d6bf81a769de52578e5"
server_key_iv: "386125800553218a44cc1fcbf054ad59"
server_key_version: "encryptionkey@0"
I20260812 02:43:07.710220 25833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "cdabb57f3f0049ffaa9b31a58977414e"
format_stamp: "Formatted at 2026-08-12 02:43:07 on dist-test-slave-2p8l"
server_key: "d903f88e42583d6bf81a769de52578e5"
server_key_iv: "386125800553218a44cc1fcbf054ad59"
server_key_version: "encryptionkey@0"
I20260812 02:43:07.713819 25833 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:43:07.716207 25856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:07.717415 25833 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:43:07.717567 25833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "cdabb57f3f0049ffaa9b31a58977414e"
format_stamp: "Formatted at 2026-08-12 02:43:07 on dist-test-slave-2p8l"
server_key: "d903f88e42583d6bf81a769de52578e5"
server_key_iv: "386125800553218a44cc1fcbf054ad59"
server_key_version: "encryptionkey@0"
I20260812 02:43:07.717689 25833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:07.747083 25833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:07.750766 25833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:07.751003 25833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:07.759096 25833 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:34243
I20260812 02:43:07.759239 25954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:34243 every 8 connection(s)
I20260812 02:43:07.760128 25833 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:43:07.762679 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 25833
I20260812 02:43:07.762813 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:43:07.763149 10541 external_mini_cluster.cc:1428] Setting key f329d2a468721741d2305cb7cf0f52cf
I20260812 02:43:07.763500 25955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:07.771795 25955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e: Bootstrap starting.
Aug 12 02:43:07 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:43:07.774503 25955 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:07.775564 25955 log.cc:824] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e: Log is configured to *not* fsync() on all Append() calls
I20260812 02:43:07.778045 25955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e: No bootstrap required, opened a new log
I20260812 02:43:07.779420 25961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:07.764802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43194 (local address 127.10.75.126:34243)
0812 02:43:07.765260 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:07.765281 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:07.765329 (+ 48us) server_negotiation.cc:407] Connection header received
0812 02:43:07.766339 (+ 1010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:07.766366 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:07.766814 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:07.767231 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:07.767951 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:07.769616 (+ 1665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:07.770627 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:07.771376 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:07.771544 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:07.774155 (+ 2611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:07.774162 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:07.774180 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:07.774218 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:07.776409 (+ 2191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:07.776871 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:07.776878 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:07.776884 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:07.777043 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:07.777319 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:07.777323 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:07.777325 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:07.777864 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:07.778127 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:07.778402 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 02:43:07.778699 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":117,"threads_started":1}
I20260812 02:43:07.782356 25955 raft_consensus.cc:348] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdabb57f3f0049ffaa9b31a58977414e" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34243 } }
I20260812 02:43:07.782634 25955 raft_consensus.cc:374] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:07.782727 25955 raft_consensus.cc:729] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdabb57f3f0049ffaa9b31a58977414e, State: Initialized, Role: FOLLOWER
I20260812 02:43:07.783259 25955 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdabb57f3f0049ffaa9b31a58977414e" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34243 } }
I20260812 02:43:07.783437 25955 raft_consensus.cc:388] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:43:07.783543 25955 raft_consensus.cc:482] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:43:07.783686 25955 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:07.784760 25955 raft_consensus.cc:504] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdabb57f3f0049ffaa9b31a58977414e" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34243 } }
I20260812 02:43:07.785095 25955 leader_election.cc:302] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cdabb57f3f0049ffaa9b31a58977414e; no voters:
I20260812 02:43:07.785395 25955 leader_election.cc:288] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:43:07.785540 25963 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:43:07.785827 25963 raft_consensus.cc:686] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [term 1 LEADER]: Becoming Leader. State: Replica: cdabb57f3f0049ffaa9b31a58977414e, State: Running, Role: LEADER
I20260812 02:43:07.786186 25963 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdabb57f3f0049ffaa9b31a58977414e" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34243 } }
I20260812 02:43:07.786808 25955 sys_catalog.cc:564] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:43:07.788026 25965 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdabb57f3f0049ffaa9b31a58977414e. Latest consensus state: current_term: 1 leader_uuid: "cdabb57f3f0049ffaa9b31a58977414e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdabb57f3f0049ffaa9b31a58977414e" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34243 } } }
I20260812 02:43:07.788213 25965 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [sys.catalog]: This master's current role is: LEADER
I20260812 02:43:07.788707 25979 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:43:07.789197 25964 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cdabb57f3f0049ffaa9b31a58977414e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdabb57f3f0049ffaa9b31a58977414e" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34243 } } }
I20260812 02:43:07.789295 25964 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [sys.catalog]: This master's current role is: LEADER
I20260812 02:43:07.791931 25979 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:43:07.797979 25979 catalog_manager.cc:1347] Generated new cluster ID: 86e44cf830544dad81366e14e364d0b9
I20260812 02:43:07.798090 25979 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:43:07.805770 25979 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:43:07.807036 25979 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:43:07.816969 25979 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e: Generated new TSK 0
I20260812 02:43:07.817770 25979 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
I20260812 02:43:07.862337 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:34243
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:40611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:43:07.976329 26003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:07.976598 26003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:07.976640 26003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:07.980746 26003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:07.980803 26003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:07.980914 26003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:43:07.986307 26003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:40611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:34243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:07.987440 26003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:07.988533 26003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:07.998214 26016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:07.998232 26014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:07.998405 26003 server_base.cc:1034] running on GCE node
W20260812 02:43:07.998221 26020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:07.998947 26003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:07.999653 26003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:08.000856 26003 hybrid_clock.cc:648] HybridClock initialized: now 1786502588000838 us; error 29 us; skew 500 ppm
Aug 12 02:43:07 dist-test-slave-2p8l krb5kdc[25806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502587, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:43:08.003690 26003 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:43:08.004565 26003 webserver.cc:460] Webserver started at http://127.10.75.65:33889/ using document root <none> and password file <none>
I20260812 02:43:08.005069 26003 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:08.005129 26003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:08.005291 26003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:08.007367 26003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "c6f7ad2a4f7c4b6692a4e5939a6fbdc3"
format_stamp: "Formatted at 2026-08-12 02:43:07 on dist-test-slave-2p8l"
server_key: "9f7cb153ac99af427e695907425ef994"
server_key_iv: "d92d1b1db64fbcd32fa0374408be4fac"
server_key_version: "encryptionkey@0"
I20260812 02:43:08.007965 26003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "c6f7ad2a4f7c4b6692a4e5939a6fbdc3"
format_stamp: "Formatted at 2026-08-12 02:43:07 on dist-test-slave-2p8l"
server_key: "9f7cb153ac99af427e695907425ef994"
server_key_iv: "d92d1b1db64fbcd32fa0374408be4fac"
server_key_version: "encryptionkey@0"
I20260812 02:43:08.011775 26003 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 02:43:08.014011 26033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:08.015506 26003 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 02:43:08.015653 26003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "c6f7ad2a4f7c4b6692a4e5939a6fbdc3"
format_stamp: "Formatted at 2026-08-12 02:43:07 on dist-test-slave-2p8l"
server_key: "9f7cb153ac99af427e695907425ef994"
server_key_iv: "d92d1b1db64fbcd32fa0374408be4fac"
server_key_version: "encryptionkey@0"
I20260812 02:43:08.015789 26003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:08.037158 26003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:08.040144 26003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:08.040311 26003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:08.040829 26003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:43:08.041623 26003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:43:08.041673 26003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:08.041712 26003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:43:08.041728 26003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:08.051111 26003 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:44375
I20260812 02:43:08.051131 26239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:44375 every 8 connection(s)
I20260812 02:43:08.052014 26003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:43:08.060196 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 26003
I20260812 02:43:08.060336 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:43:08.060700 10541 external_mini_cluster.cc:1428] Setting key b5569b7986b385685443732d6874d3be
Aug 12 02:43:08 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502587, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:43:08.066624 25961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:08.053935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:41423 (local address 127.10.75.126:34243)
0812 02:43:08.054139 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:08.054143 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:08.054944 (+ 801us) server_negotiation.cc:407] Connection header received
0812 02:43:08.056246 (+ 1302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:08.056250 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:08.056310 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:08.056424 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:08.057568 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:08.058185 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:08.059350 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:08.059592 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:08.059716 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:08.062589 (+ 2873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:08.062593 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:08.062596 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:08.062625 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:08.064440 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:08.064978 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:08.064983 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:08.064984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:08.065070 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:08.065436 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:08.065441 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:08.065442 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:08.065666 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:08.065783 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:08.066384 (+ 601us) server_negotiation.cc:299] Negotiation successful
0812 02:43:08.066499 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 02:43:08.067812 26244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:08.054319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.65:41423)
0812 02:43:08.054790 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:08.054833 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:08.056018 (+ 1185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:08.056601 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:08.056608 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:08.056952 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:08.057408 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:08.057421 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:08.058339 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:08.058343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:08.059206 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:08.059216 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:08.059759 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:08.059764 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:08.059933 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:08.060620 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:08.060642 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:08.062413 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:43:08.064575 (+ 2162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:08.064581 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:08.064596 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:08.064853 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:08.065173 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:08.065177 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:08.065179 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:08.065329 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:08.065783 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:43:08.065791 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:43:08.066028 (+ 237us) client_negotiation.cc:769] Sending connection context
0812 02:43:08.066320 (+ 292us) client_negotiation.cc:240] Negotiation successful
0812 02:43:08.066676 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":113,"threads_started":1}
I20260812 02:43:08.069154 26240 heartbeater.cc:347] Connected to a master server at 127.10.75.126:34243
I20260812 02:43:08.069422 26240 heartbeater.cc:464] Registering TS with master...
I20260812 02:43:08.069937 26240 heartbeater.cc:511] Master 127.10.75.126:34243 requested a full tablet report, sending...
I20260812 02:43:08.071542 25878 ts_manager.cc:194] Registered new tserver with Master: c6f7ad2a4f7c4b6692a4e5939a6fbdc3 (127.10.75.65:44375)
WARNING: no policy specified for kudu/127.10.75.66@KRBTEST.COM; defaulting to no policy
I20260812 02:43:08.072793 25878 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:41423
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
I20260812 02:43:08.094272 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:34243
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:40611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:43:08.208061 26251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:08.208290 26251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:08.208330 26251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:08.212177 26251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:08.212229 26251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:08.212383 26251 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:43:08.217561 26251 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:40611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:34243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:08.218482 26251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:08.219419 26251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:08.229053 26267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:08.229105 26271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:08.229053 26273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:08.229480 26251 server_base.cc:1034] running on GCE node
I20260812 02:43:08.229918 26251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:08.230669 26251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:08.231858 26251 hybrid_clock.cc:648] HybridClock initialized: now 1786502588231819 us; error 46 us; skew 500 ppm
Aug 12 02:43:08 dist-test-slave-2p8l krb5kdc[25806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502588, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:43:08.234836 26251 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:43:08.235724 26251 webserver.cc:460] Webserver started at http://127.10.75.66:35043/ using document root <none> and password file <none>
I20260812 02:43:08.236258 26251 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:08.236330 26251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:08.236567 26251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:08.238622 26251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "29b9b931ef0f4857af64ae1ba5d3fbe9"
format_stamp: "Formatted at 2026-08-12 02:43:08 on dist-test-slave-2p8l"
server_key: "130890c0981d4c7daf1822fc1fb0d950"
server_key_iv: "463ea5247bd443307fc432ff8327ba1b"
server_key_version: "encryptionkey@0"
I20260812 02:43:08.239182 26251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "29b9b931ef0f4857af64ae1ba5d3fbe9"
format_stamp: "Formatted at 2026-08-12 02:43:08 on dist-test-slave-2p8l"
server_key: "130890c0981d4c7daf1822fc1fb0d950"
server_key_iv: "463ea5247bd443307fc432ff8327ba1b"
server_key_version: "encryptionkey@0"
I20260812 02:43:08.242748 26251 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:43:08.245141 26288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:08.246390 26251 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:43:08.246519 26251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "29b9b931ef0f4857af64ae1ba5d3fbe9"
format_stamp: "Formatted at 2026-08-12 02:43:08 on dist-test-slave-2p8l"
server_key: "130890c0981d4c7daf1822fc1fb0d950"
server_key_iv: "463ea5247bd443307fc432ff8327ba1b"
server_key_version: "encryptionkey@0"
I20260812 02:43:08.246647 26251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:08.264587 26251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:08.267544 26251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:08.267758 26251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:08.268342 26251 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:43:08.269176 26251 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:43:08.269225 26251 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:08.269294 26251 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:43:08.269328 26251 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:08.278612 26251 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:44387
I20260812 02:43:08.278652 26497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:44387 every 8 connection(s)
I20260812 02:43:08.279560 26251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:43:08.283634 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 26251
I20260812 02:43:08.283787 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:43:08.284051 10541 external_mini_cluster.cc:1428] Setting key 3922baeab2376657853208d6359af37a
Aug 12 02:43:08 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502588, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:43:08.294770 25961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:08.281275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:47063 (local address 127.10.75.126:34243)
0812 02:43:08.281411 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:08.281415 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:08.282483 (+ 1068us) server_negotiation.cc:407] Connection header received
0812 02:43:08.283416 (+ 933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:08.283421 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:08.283480 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:08.283585 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:08.285022 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:08.285764 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:08.286968 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:08.287395 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:08.287522 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:08.290462 (+ 2940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:08.290465 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:08.290467 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:08.290490 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:08.292307 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:08.292859 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:08.292865 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:08.292868 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:08.292978 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:08.293431 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:08.293438 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:08.293441 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:08.293710 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:08.293821 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:08.294405 (+ 584us) server_negotiation.cc:299] Negotiation successful
0812 02:43:08.294547 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":53}
I20260812 02:43:08.295347 26505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:08.281665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.66:47063)
0812 02:43:08.282343 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:08.282384 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:08.283137 (+ 753us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:08.283775 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:08.283791 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:08.284249 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:08.284874 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:08.284892 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:08.285896 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:08.285899 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:08.286820 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:08.286830 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:08.287564 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:08.287571 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:08.287830 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:08.288563 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:08.288579 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:08.290270 (+ 1691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:43:08.292440 (+ 2170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:08.292448 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:08.292465 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:08.292730 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:08.293130 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:08.293133 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:08.293134 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:08.293273 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:08.293826 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:43:08.293831 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:43:08.294111 (+ 280us) client_negotiation.cc:769] Sending connection context
0812 02:43:08.294290 (+ 179us) client_negotiation.cc:240] Negotiation successful
0812 02:43:08.294537 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":100,"threads_started":1}
WARNING: no policy specified for kudu/127.10.75.67@KRBTEST.COM; defaulting to no policy
I20260812 02:43:08.296551 26500 heartbeater.cc:347] Connected to a master server at 127.10.75.126:34243
I20260812 02:43:08.296794 26500 heartbeater.cc:464] Registering TS with master...
I20260812 02:43:08.297318 26500 heartbeater.cc:511] Master 127.10.75.126:34243 requested a full tablet report, sending...
I20260812 02:43:08.298452 25878 ts_manager.cc:194] Registered new tserver with Master: 29b9b931ef0f4857af64ae1ba5d3fbe9 (127.10.75.66:44387)
I20260812 02:43:08.299140 25878 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:47063
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
I20260812 02:43:08.315531 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:34243
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:40611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:43:08.426741 26509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:08.426972 26509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:08.427054 26509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:08.431007 26509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:08.431058 26509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:08.431213 26509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:43:08.436213 26509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:40611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:34243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:08.437150 26509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:08.438203 26509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:08.448009 26518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:08.448015 26521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:08.447985 26524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:08.448371 26509 server_base.cc:1034] running on GCE node
I20260812 02:43:08.448894 26509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:08.449564 26509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:08.450753 26509 hybrid_clock.cc:648] HybridClock initialized: now 1786502588450735 us; error 28 us; skew 500 ppm
Aug 12 02:43:08 dist-test-slave-2p8l krb5kdc[25806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502588, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:43:08.453451 26509 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:43:08.454280 26509 webserver.cc:460] Webserver started at http://127.10.75.67:33097/ using document root <none> and password file <none>
I20260812 02:43:08.454773 26509 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:08.454830 26509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:08.454978 26509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:08.456796 26509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "8fdfa852db5c41b6b053b1f9ab3898bd"
format_stamp: "Formatted at 2026-08-12 02:43:08 on dist-test-slave-2p8l"
server_key: "39c783f79e991d0d520bf00b90ae9bd8"
server_key_iv: "cca89cf1e8326948737d97a62f4f6439"
server_key_version: "encryptionkey@0"
I20260812 02:43:08.457275 26509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "8fdfa852db5c41b6b053b1f9ab3898bd"
format_stamp: "Formatted at 2026-08-12 02:43:08 on dist-test-slave-2p8l"
server_key: "39c783f79e991d0d520bf00b90ae9bd8"
server_key_iv: "cca89cf1e8326948737d97a62f4f6439"
server_key_version: "encryptionkey@0"
I20260812 02:43:08.460767 26509 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260812 02:43:08.463151 26534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:08.464295 26509 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:43:08.464390 26509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "8fdfa852db5c41b6b053b1f9ab3898bd"
format_stamp: "Formatted at 2026-08-12 02:43:08 on dist-test-slave-2p8l"
server_key: "39c783f79e991d0d520bf00b90ae9bd8"
server_key_iv: "cca89cf1e8326948737d97a62f4f6439"
server_key_version: "encryptionkey@0"
I20260812 02:43:08.464470 26509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:08.475930 26509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:08.478705 26509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:08.478856 26509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:08.479363 26509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:43:08.480111 26509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:43:08.480158 26509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:08.480197 26509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:43:08.480214 26509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:08.489574 26509 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:39249
I20260812 02:43:08.489689 26730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:39249 every 8 connection(s)
I20260812 02:43:08.490561 26509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:43:08.492137 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 26509
I20260812 02:43:08.492271 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:43:08.492599 10541 external_mini_cluster.cc:1428] Setting key 13eda9ddb4b337277821da21ba84b1f2
Aug 12 02:43:08 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502588, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:43:08.504345 25961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:08.492603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:47859 (local address 127.10.75.126:34243)
0812 02:43:08.492763 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:08.492766 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:08.493970 (+ 1204us) server_negotiation.cc:407] Connection header received
0812 02:43:08.494923 (+ 953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:08.494926 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:08.494986 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:08.495076 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:08.496223 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:08.496770 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:08.497935 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:08.498272 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:08.498396 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:08.500824 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:08.500827 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:08.500829 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:08.500854 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:08.502261 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:08.502773 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:08.502775 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:08.502777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:08.502852 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:08.503242 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:08.503244 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:08.503245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:08.503410 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:08.503506 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:08.504128 (+ 622us) server_negotiation.cc:299] Negotiation successful
0812 02:43:08.504225 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 02:43:08.505200 26733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:08.493053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.67:47859)
0812 02:43:08.493818 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:08.493861 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:08.494711 (+ 850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:08.495253 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:08.495260 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:08.495617 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:08.496070 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:08.496083 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:08.496919 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:08.496925 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:08.497793 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:08.497803 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:08.498434 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:08.498438 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:08.498621 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:08.499146 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:08.499161 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:08.500666 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:43:08.502370 (+ 1704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:08.502375 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:08.502385 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:08.502678 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:08.502969 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:08.502972 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:08.502974 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:08.503145 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:08.503589 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:43:08.503596 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:43:08.503909 (+ 313us) client_negotiation.cc:769] Sending connection context
0812 02:43:08.504081 (+ 172us) client_negotiation.cc:240] Negotiation successful
0812 02:43:08.504328 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":122,"threads_started":1}
I20260812 02:43:08.506393 26731 heartbeater.cc:347] Connected to a master server at 127.10.75.126:34243
I20260812 02:43:08.506630 26731 heartbeater.cc:464] Registering TS with master...
I20260812 02:43:08.507114 26731 heartbeater.cc:511] Master 127.10.75.126:34243 requested a full tablet report, sending...
I20260812 02:43:08.508142 25878 ts_manager.cc:194] Registered new tserver with Master: 8fdfa852db5c41b6b053b1f9ab3898bd (127.10.75.67:39249)
I20260812 02:43:08.508666 25878 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:47859
I20260812 02:43:08.518700 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.65.keytab.
Entry for principal oryx/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.65.keytab.
WARNING: no policy specified for oryx/127.10.75.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.75.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.66.keytab.
Entry for principal oryx/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.66.keytab.
WARNING: no policy specified for oryx/127.10.75.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.75.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.67.keytab.
Entry for principal oryx/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.67.keytab.
I20260812 02:43:08.605894 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 26003
I20260812 02:43:08.626580 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 26251
I20260812 02:43:08.635824 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 26509
I20260812 02:43:08.653710 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 25833
I20260812 02:43:08.665001 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:34243
--webserver_interface=127.10.75.126
--webserver_port=37697
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:40611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:34243
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:43:08.776928 26749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:08.777174 26749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:08.777215 26749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:08.781307 26749 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:43:08.781359 26749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:08.781379 26749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:08.781396 26749 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:43:08.781455 26749 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:43:08.786835 26749 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:40611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:34243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:34243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=37697
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:08.787837 26749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:08.788849 26749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:08.797286 26762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:08.797273 26755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:08.797273 26759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:08.797698 26749 server_base.cc:1034] running on GCE node
I20260812 02:43:08.798384 26749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:08.799475 26749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:08.800691 26749 hybrid_clock.cc:648] HybridClock initialized: now 1786502588800669 us; error 27 us; skew 500 ppm
Aug 12 02:43:08 dist-test-slave-2p8l krb5kdc[25806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502588, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:43:08.808615 26749 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:43:08.809595 26749 webserver.cc:460] Webserver started at http://127.10.75.126:37697/ using document root <none> and password file <none>
I20260812 02:43:08.810263 26749 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:08.810384 26749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:08.814284 26749 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260812 02:43:08.816452 26771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:08.817618 26749 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:43:08.817792 26749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "cdabb57f3f0049ffaa9b31a58977414e"
format_stamp: "Formatted at 2026-08-12 02:43:07 on dist-test-slave-2p8l"
server_key: "d903f88e42583d6bf81a769de52578e5"
server_key_iv: "386125800553218a44cc1fcbf054ad59"
server_key_version: "encryptionkey@0"
I20260812 02:43:08.818416 26749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:08.843127 26749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:08.847083 26749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:08.847324 26749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:08.858144 26749 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:34243
I20260812 02:43:08.858173 26871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:34243 every 8 connection(s)
I20260812 02:43:08.859598 26749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:43:08.865276 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 26749
I20260812 02:43:08.865885 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:44375
--local_ip_for_outbound_sockets=127.10.75.65
--tserver_master_addrs=127.10.75.126:34243
--webserver_port=33889
--webserver_interface=127.10.75.65
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:40611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.75.65
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:43:08.866034 26874 sys_catalog.cc:263] Verifying existing consensus state
I20260812 02:43:08.868614 26874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e: Bootstrap starting.
I20260812 02:43:08.893131 26874 log.cc:824] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e: Log is configured to *not* fsync() on all Append() calls
I20260812 02:43:08.901615 26874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 02:43:08.902096 26874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e: Bootstrap complete.
I20260812 02:43:08.907986 26874 raft_consensus.cc:348] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdabb57f3f0049ffaa9b31a58977414e" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34243 } }
I20260812 02:43:08.908483 26874 raft_consensus.cc:729] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdabb57f3f0049ffaa9b31a58977414e, State: Initialized, Role: FOLLOWER
I20260812 02:43:08.909019 26874 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdabb57f3f0049ffaa9b31a58977414e" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34243 } }
I20260812 02:43:08.909159 26874 raft_consensus.cc:388] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:43:08.909230 26874 raft_consensus.cc:482] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:43:08.909325 26874 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [term 1 FOLLOWER]: Advancing to term 2
I20260812 02:43:08.911931 26874 raft_consensus.cc:504] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdabb57f3f0049ffaa9b31a58977414e" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34243 } }
I20260812 02:43:08.912283 26874 leader_election.cc:302] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cdabb57f3f0049ffaa9b31a58977414e; no voters:
I20260812 02:43:08.912640 26874 leader_election.cc:288] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 02:43:08.912803 26879 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [term 2 FOLLOWER]: Leader election won for term 2
I20260812 02:43:08.913066 26879 raft_consensus.cc:686] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [term 2 LEADER]: Becoming Leader. State: Replica: cdabb57f3f0049ffaa9b31a58977414e, State: Running, Role: LEADER
I20260812 02:43:08.913367 26879 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdabb57f3f0049ffaa9b31a58977414e" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34243 } }
I20260812 02:43:08.913887 26874 sys_catalog.cc:564] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:43:08.914901 26880 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "cdabb57f3f0049ffaa9b31a58977414e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdabb57f3f0049ffaa9b31a58977414e" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34243 } } }
I20260812 02:43:08.914928 26881 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdabb57f3f0049ffaa9b31a58977414e. Latest consensus state: current_term: 2 leader_uuid: "cdabb57f3f0049ffaa9b31a58977414e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdabb57f3f0049ffaa9b31a58977414e" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 34243 } } }
I20260812 02:43:08.915040 26881 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [sys.catalog]: This master's current role is: LEADER
I20260812 02:43:08.915040 26880 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e [sys.catalog]: This master's current role is: LEADER
I20260812 02:43:08.918808 26903 catalog_manager.cc:1259] Loaded cluster ID: 86e44cf830544dad81366e14e364d0b9
I20260812 02:43:08.918884 26903 catalog_manager.cc:1552] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e: loading cluster ID for follower catalog manager: success
I20260812 02:43:08.920540 26903 catalog_manager.cc:1574] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e: acquiring CA information for follower catalog manager: success
I20260812 02:43:08.921725 26903 catalog_manager.cc:1602] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 02:43:08.921854 26892 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:43:08.922770 26892 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:43:08.923230 26892 catalog_manager.cc:1259] Loaded cluster ID: 86e44cf830544dad81366e14e364d0b9
I20260812 02:43:08.923301 26892 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:43:08.923959 26892 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:43:08.924381 26892 catalog_manager.cc:5879] T 00000000000000000000000000000000 P cdabb57f3f0049ffaa9b31a58977414e: Loaded TSK: 0
I20260812 02:43:08.925005 26892 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 02:43:09.013619 26877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:09.013909 26877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:09.013986 26877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:09.018404 26877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:09.018481 26877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:09.018595 26877 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:43:09.025254 26877 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:40611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.65.keytab
--principal=oryx/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:44375
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=33889
--tserver_master_addrs=127.10.75.126:34243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26877
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:09.026288 26877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:09.027311 26877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:09.036871 26911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:09.036895 26913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:09.036904 26910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:09.037766 26877 server_base.cc:1034] running on GCE node
I20260812 02:43:09.038245 26877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:09.038929 26877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:09.040115 26877 hybrid_clock.cc:648] HybridClock initialized: now 1786502589040096 us; error 36 us; skew 500 ppm
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502589, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:43:09.043360 26877 init.cc:377] Logged in from keytab as oryx/127.10.75.65@KRBTEST.COM (short username oryx)
I20260812 02:43:09.044312 26877 webserver.cc:460] Webserver started at http://127.10.75.65:33889/ using document root <none> and password file <none>
I20260812 02:43:09.044900 26877 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:09.045018 26877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:09.050338 26877 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 02:43:09.054324 26926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:09.056214 26877 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 02:43:09.056344 26877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "c6f7ad2a4f7c4b6692a4e5939a6fbdc3"
format_stamp: "Formatted at 2026-08-12 02:43:07 on dist-test-slave-2p8l"
server_key: "9f7cb153ac99af427e695907425ef994"
server_key_iv: "d92d1b1db64fbcd32fa0374408be4fac"
server_key_version: "encryptionkey@0"
I20260812 02:43:09.057045 26877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:09.075516 26877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:09.078699 26877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:09.078922 26877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:09.079587 26877 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:43:09.080489 26877 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:43:09.080574 26877 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:09.080672 26877 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:43:09.080736 26877 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:09.090819 26877 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:44375
I20260812 02:43:09.090850 27120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:44375 every 8 connection(s)
I20260812 02:43:09.091792 26877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:43:09.094976 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 26877
I20260812 02:43:09.095435 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:44387
--local_ip_for_outbound_sockets=127.10.75.66
--tserver_master_addrs=127.10.75.126:34243
--webserver_port=35043
--webserver_interface=127.10.75.66
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:40611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.75.66
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 02:43:09.106047 27123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:09.093861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:57529 (local address 127.10.75.126:34243)
0812 02:43:09.094437 (+ 576us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:09.094457 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:09.094908 (+ 451us) server_negotiation.cc:407] Connection header received
0812 02:43:09.096117 (+ 1209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:09.096128 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:09.096402 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:09.096721 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:09.097862 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.098886 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.100641 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.101186 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.101321 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:09.105345 (+ 4024us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.65:57529: BlockingRecv error: recv got EOF from 127.10.75.65:57529 (error 108)
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":153,"threads_started":1}
I20260812 02:43:09.106096 27124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:09.093988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.65:57529)
0812 02:43:09.094739 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:09.094779 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:09.095707 (+ 928us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:09.096807 (+ 1100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:09.096815 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:09.097241 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:09.097661 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:09.097683 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.099038 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.099044 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:09.100497 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:09.100513 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.101380 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.101386 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:09.101617 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:09.102366 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:09.102392 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:09.105127 (+ 2735us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":134,"threads_started":1}
W20260812 02:43:09.106528 27121 heartbeater.cc:644] Failed to heartbeat to 127.10.75.126:34243 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.75.126:34243: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:09.112032 27124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:09.106960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.65:58091)
0812 02:43:09.107070 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:09.107086 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:09.107165 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:09.107445 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:09.107448 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:09.107605 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:09.107691 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:09.107696 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.108425 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.108430 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:09.108969 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:09.108977 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.109463 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.109467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:09.109568 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:09.110094 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:09.110114 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:09.111912 (+ 1798us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 02:43:09.112422 27123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:09.107097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:58091 (local address 127.10.75.126:34243)
0812 02:43:09.107252 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:09.107256 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:09.107269 (+ 13us) server_negotiation.cc:407] Connection header received
0812 02:43:09.107303 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:09.107305 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:09.107339 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:09.107429 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:09.107821 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.108308 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.109100 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.109343 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.109459 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:09.112040 (+ 2581us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.65:58091: BlockingRecv error: recv got EOF from 127.10.75.65:58091 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:09.117947 27124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:09.112559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.65:57271)
0812 02:43:09.112794 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:09.112807 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:09.112874 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:09.113075 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:09.113078 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:09.113232 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:09.113313 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:09.113319 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.114078 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.114081 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:09.115007 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:09.115023 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.115487 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.115491 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:09.115574 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:09.116034 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:09.116048 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:09.117831 (+ 1783us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171}
W20260812 02:43:09.118057 27123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:09.112781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:57271 (local address 127.10.75.126:34243)
0812 02:43:09.112896 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:09.112899 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:09.112910 (+ 11us) server_negotiation.cc:407] Connection header received
0812 02:43:09.112939 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:09.112941 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:09.112972 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:09.113035 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:09.113451 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.113962 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.115137 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.115350 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.115473 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:09.117942 (+ 2469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.65:57271: BlockingRecv error: recv got EOF from 127.10.75.65:57271 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260812 02:43:09.118252 27121 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 02:43:09.210954 27125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:09.211189 27125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:09.211228 27125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:09.215236 27125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:09.215288 27125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:09.215343 27125 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:43:09.220439 27125 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:40611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.66.keytab
--principal=oryx/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:44387
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=35043
--tserver_master_addrs=127.10.75.126:34243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:09.221349 27125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:09.222358 27125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:09.231839 27142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:09.231834 27136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:09.231953 27125 server_base.cc:1034] running on GCE node
W20260812 02:43:09.231904 27132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:09.232494 27125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:09.233146 27125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:09.234330 27125 hybrid_clock.cc:648] HybridClock initialized: now 1786502589234306 us; error 48 us; skew 500 ppm
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502589, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:43:09.237036 27125 init.cc:377] Logged in from keytab as oryx/127.10.75.66@KRBTEST.COM (short username oryx)
I20260812 02:43:09.237931 27125 webserver.cc:460] Webserver started at http://127.10.75.66:35043/ using document root <none> and password file <none>
I20260812 02:43:09.238520 27125 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:09.238600 27125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:09.242398 27125 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 02:43:09.244431 27164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:09.245700 27125 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:43:09.245851 27125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "29b9b931ef0f4857af64ae1ba5d3fbe9"
format_stamp: "Formatted at 2026-08-12 02:43:08 on dist-test-slave-2p8l"
server_key: "130890c0981d4c7daf1822fc1fb0d950"
server_key_iv: "463ea5247bd443307fc432ff8327ba1b"
server_key_version: "encryptionkey@0"
I20260812 02:43:09.246455 27125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:09.258926 27125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:09.262008 27125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:09.262239 27125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:09.262823 27125 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:43:09.263643 27125 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:43:09.263720 27125 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:09.263790 27125 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:43:09.263841 27125 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:09.273069 27125 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:44387
I20260812 02:43:09.273108 27371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:44387 every 8 connection(s)
I20260812 02:43:09.274036 27125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:09.283701 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 27125
I20260812 02:43:09.284134 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:39249
--local_ip_for_outbound_sockets=127.10.75.67
--tserver_master_addrs=127.10.75.126:34243
--webserver_port=33097
--webserver_interface=127.10.75.67
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:40611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.75.67
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:43:09.284478 27123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:09.275850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:41433 (local address 127.10.75.126:34243)
0812 02:43:09.275995 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:09.275999 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:09.276939 (+ 940us) server_negotiation.cc:407] Connection header received
0812 02:43:09.277721 (+ 782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:09.277724 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:09.277775 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:09.277850 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:09.279008 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.279535 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.280598 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.280802 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.280876 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:09.284355 (+ 3479us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.66:41433: BlockingRecv error: recv got EOF from 127.10.75.66:41433 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 02:43:09.285178 27376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:09.276140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.66:41433)
0812 02:43:09.276786 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:09.276825 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:09.277543 (+ 718us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:09.278019 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:09.278025 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:09.278434 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:09.278879 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:09.278892 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.279648 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.279651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:09.280492 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:09.280501 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.280932 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.280935 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:09.281065 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:09.281704 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:09.281719 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:09.284234 (+ 2515us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":113,"threads_started":1}
W20260812 02:43:09.285724 27373 heartbeater.cc:644] Failed to heartbeat to 127.10.75.126:34243 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.75.126:34243: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:09.291507 27376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:09.286214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.66:56539)
0812 02:43:09.286341 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:09.286358 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:09.286437 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:09.286682 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:09.286687 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:09.286863 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:09.286987 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:09.286995 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.287685 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.287692 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:09.288282 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:09.288291 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.288766 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.288769 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:09.288865 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:09.289383 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:09.289406 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:09.291335 (+ 1929us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 02:43:09.291617 27123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:09.286350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:56539 (local address 127.10.75.126:34243)
0812 02:43:09.286457 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:09.286460 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:09.286491 (+ 31us) server_negotiation.cc:407] Connection header received
0812 02:43:09.286524 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:09.286525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:09.286559 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:09.286614 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:09.287106 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.287566 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.288419 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.288649 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.288763 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:09.291484 (+ 2721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.66:56539: BlockingRecv error: recv got EOF from 127.10.75.66:56539 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:09.297945 27376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:09.292273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.66:48831)
0812 02:43:09.292393 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:09.292408 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:09.292481 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:09.292799 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:09.292805 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:09.292985 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:09.293101 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:09.293112 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.293797 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.293802 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:09.294792 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:09.294806 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.295267 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.295273 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:09.295384 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:09.295840 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:09.295861 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:09.297830 (+ 1969us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 02:43:09.298072 27123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:09.292372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:48831 (local address 127.10.75.126:34243)
0812 02:43:09.292603 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:09.292606 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:09.292615 (+ 9us) server_negotiation.cc:407] Connection header received
0812 02:43:09.292643 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:09.292646 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:09.292677 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:09.292734 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:09.293231 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.293680 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.294937 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.295132 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.295221 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:09.297946 (+ 2725us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.66:48831: BlockingRecv error: recv got EOF from 127.10.75.66:48831 (error 108)
Metrics: {"server-negotiator.queue_time_us":161}
W20260812 02:43:09.298151 27373 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 02:43:09.398588 27377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:09.398833 27377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:09.398875 27377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:09.402793 27377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:09.402844 27377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:09.402900 27377 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:43:09.407994 27377 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:40611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/krb5kdc/oryx_127.10.75.67.keytab
--principal=oryx/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:39249
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=33097
--tserver_master_addrs=127.10.75.126:34243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27377
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:09.408949 27377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:09.409916 27377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:09.419721 27389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:09.419734 27386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:09.419734 27394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:09.419957 27377 server_base.cc:1034] running on GCE node
I20260812 02:43:09.420416 27377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:09.421011 27377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:09.422137 27377 hybrid_clock.cc:648] HybridClock initialized: now 1786502589422116 us; error 32 us; skew 500 ppm
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502589, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:43:09.425033 27377 init.cc:377] Logged in from keytab as oryx/127.10.75.67@KRBTEST.COM (short username oryx)
I20260812 02:43:09.425917 27377 webserver.cc:460] Webserver started at http://127.10.75.67:33097/ using document root <none> and password file <none>
I20260812 02:43:09.426524 27377 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:09.426640 27377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:09.430405 27377 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260812 02:43:09.432487 27412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:09.433666 27377 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:43:09.433815 27377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "8fdfa852db5c41b6b053b1f9ab3898bd"
format_stamp: "Formatted at 2026-08-12 02:43:08 on dist-test-slave-2p8l"
server_key: "39c783f79e991d0d520bf00b90ae9bd8"
server_key_iv: "cca89cf1e8326948737d97a62f4f6439"
server_key_version: "encryptionkey@0"
I20260812 02:43:09.434393 27377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:09.445801 27377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:09.448606 27377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:09.448807 27377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:09.449396 27377 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:43:09.450196 27377 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:43:09.450273 27377 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:09.450336 27377 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:43:09.450372 27377 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:09.459591 27377 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:39249
I20260812 02:43:09.459622 27612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:39249 every 8 connection(s)
I20260812 02:43:09.460515 27377 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:43:09.462194 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 27377
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 02:43:09.472401 27123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:09.462450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:53229 (local address 127.10.75.126:34243)
0812 02:43:09.462657 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:09.462664 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:09.463750 (+ 1086us) server_negotiation.cc:407] Connection header received
0812 02:43:09.464790 (+ 1040us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:09.464793 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:09.464834 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:09.464897 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:09.466195 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.466825 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.468157 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.468435 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.468511 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:09.472276 (+ 3765us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.67:53229: BlockingRecv error: recv got EOF from 127.10.75.67:53229 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
I20260812 02:43:09.472769 27619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:09.463230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43210 (local address 127.10.75.126:34243)
0812 02:43:09.463478 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:09.463482 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:09.463497 (+ 15us) server_negotiation.cc:407] Connection header received
0812 02:43:09.463559 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:09.463582 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:09.463634 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:09.463742 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:09.464605 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.465442 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.466488 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.466754 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.466836 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:09.468332 (+ 1496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:09.468337 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:09.468350 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:09.468377 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:09.470389 (+ 2012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:09.470931 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:09.470942 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:09.470951 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:09.471109 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:09.471484 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:09.471486 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:09.471488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:09.471817 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:09.471970 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:09.472338 (+ 368us) server_negotiation.cc:299] Negotiation successful
0812 02:43:09.472655 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":80,"threads_started":1}
I20260812 02:43:09.473184 27618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:09.462840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.67:53229)
0812 02:43:09.463612 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:09.463670 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:09.464547 (+ 877us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:09.465087 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:09.465096 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:09.465553 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:09.466023 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:09.466036 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.466980 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.466982 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:09.468017 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:09.468028 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.468595 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.468600 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:09.468812 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:09.469334 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:09.469373 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:09.472128 (+ 2755us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":167,"threads_started":1}
W20260812 02:43:09.473719 27614 heartbeater.cc:644] Failed to heartbeat to 127.10.75.126:34243 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.75.126:34243: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:09.479246 27618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:09.474199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.67:36677)
0812 02:43:09.474355 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:09.474369 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:09.474442 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:09.474932 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:09.474934 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:09.475116 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:09.475233 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:09.475240 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.476060 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.476063 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:09.476580 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:09.476587 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.476981 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.476984 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:09.477049 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:09.477511 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:09.477525 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:09.479135 (+ 1610us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":95}
W20260812 02:43:09.479562 27619 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:09.474281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:36677 (local address 127.10.75.126:34243)
0812 02:43:09.474388 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:09.474392 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:09.474405 (+ 13us) server_negotiation.cc:407] Connection header received
0812 02:43:09.474545 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:09.474548 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:09.474590 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:09.474918 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:09.475351 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.475952 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.476682 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.476886 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.476960 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:09.479396 (+ 2436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.67:36677: BlockingRecv error: recv got EOF from 127.10.75.67:36677 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:09 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:09.484560 27618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:09.479753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.67:49571)
0812 02:43:09.479863 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:09.479879 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:09.479963 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:09.480285 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:09.480287 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:09.480402 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:09.480485 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:09.480489 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.481136 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.481138 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:09.481577 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:09.481583 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.482004 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.482010 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:09.482115 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:09.482602 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:09.482620 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:09.484460 (+ 1840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 02:43:09.484773 27619 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:09.479995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:49571 (local address 127.10.75.126:34243)
0812 02:43:09.480115 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:09.480118 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:09.480127 (+ 9us) server_negotiation.cc:407] Connection header received
0812 02:43:09.480155 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:09.480156 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:09.480185 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:09.480242 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:09.480609 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.481051 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.481705 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:09.481882 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:09.481969 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:09.484642 (+ 2673us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.67:49571: BlockingRecv error: recv got EOF from 127.10.75.67:49571 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260812 02:43:09.484838 27614 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 02:43:10 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:10 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:10.125707 27620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:10.119205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.65:58547)
0812 02:43:10.119579 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:10.119596 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:10.119723 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:10.120038 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:10.120040 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:10.120271 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:10.120432 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:10.120438 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:10.121282 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:10.121285 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:10.121917 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:10.121925 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:10.122444 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:10.122447 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:10.122579 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:10.123336 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:10.123350 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:10.125558 (+ 2208us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":128,"threads_started":1}
W20260812 02:43:10.125945 27621 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:10.119290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:58547 (local address 127.10.75.126:34243)
0812 02:43:10.119607 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:10.119613 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:10.119678 (+ 65us) server_negotiation.cc:407] Connection header received
0812 02:43:10.119824 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:10.119827 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:10.119886 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:10.119993 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:10.120558 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:10.121167 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:10.122046 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:10.122331 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:10.122521 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:10.125742 (+ 3221us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.65:58547: BlockingRecv error: recv got EOF from 127.10.75.65:58547 (error 108)
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":85,"threads_started":1}
Aug 12 02:43:10 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:10 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:10.305473 27622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:10.299066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.66:53719)
0812 02:43:10.299490 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:10.299507 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:10.299644 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:10.299929 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:10.299931 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:10.300174 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:10.300304 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:10.300311 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:10.301138 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:10.301142 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:10.301758 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:10.301769 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:10.302335 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:10.302339 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:10.302417 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:10.303144 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:10.303158 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:10.305304 (+ 2146us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":156,"threads_started":1}
W20260812 02:43:10.305714 27621 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:10.299121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:53719 (local address 127.10.75.126:34243)
0812 02:43:10.299316 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:10.299322 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:10.299593 (+ 271us) server_negotiation.cc:407] Connection header received
0812 02:43:10.299737 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:10.299739 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:10.299794 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:10.299870 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:10.300419 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:10.300997 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:10.301945 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:10.302211 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:10.302294 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:10.305552 (+ 3258us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.66:53719: BlockingRecv error: recv got EOF from 127.10.75.66:53719 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 12 02:43:10 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:10 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:10.492386 27624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:10.485697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.67:56215)
0812 02:43:10.486206 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:10.486223 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:10.486419 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:10.486759 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:10.486762 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:10.487037 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:10.487152 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:10.487159 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:10.488037 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:10.488042 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:10.488729 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:10.488739 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:10.489263 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:10.489267 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:10.489369 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:10.490021 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:10.490034 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:10.492218 (+ 2184us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":122,"threads_started":1}
W20260812 02:43:10.492554 27621 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:10.485846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:56215 (local address 127.10.75.126:34243)
0812 02:43:10.486136 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:10.486143 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:10.486341 (+ 198us) server_negotiation.cc:407] Connection header received
0812 02:43:10.486555 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:10.486561 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:10.486628 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:10.486728 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:10.487283 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:10.487911 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:10.488875 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:10.489122 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:10.489242 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:10.492409 (+ 3167us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.67:56215: BlockingRecv error: recv got EOF from 127.10.75.67:56215 (error 108)
Metrics: {"server-negotiator.queue_time_us":117}
Aug 12 02:43:11 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:11 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:11.132778 27626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:11.126693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.65:37237)
0812 02:43:11.127073 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:11.127086 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:11.127223 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:11.127550 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:11.127553 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:11.127794 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:11.127908 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:11.127914 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:11.128729 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:11.128734 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:11.129331 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:11.129339 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:11.129831 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:11.129835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:11.129921 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:11.130589 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:11.130601 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:11.132576 (+ 1975us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":89,"threads_started":1}
W20260812 02:43:11.132834 27628 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:11.126707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:37237 (local address 127.10.75.126:34243)
0812 02:43:11.126989 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:11.126994 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:11.127170 (+ 176us) server_negotiation.cc:407] Connection header received
0812 02:43:11.127342 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:11.127345 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:11.127406 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:11.127510 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:11.128047 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:11.128609 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:11.129460 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:11.129706 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:11.129826 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:11.132705 (+ 2879us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.65:37237: BlockingRecv error: recv got EOF from 127.10.75.65:37237 (error 108)
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":91,"threads_started":1}
Aug 12 02:43:11 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:11 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:11.312214 27631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:11.306323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.66:34849)
0812 02:43:11.306647 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:11.306662 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:11.306775 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:11.307060 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:11.307063 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:11.307261 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:11.307370 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:11.307376 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:11.308157 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:11.308160 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:11.308762 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:11.308771 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:11.309221 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:11.309224 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:11.309293 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:11.309812 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:11.309823 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:11.312014 (+ 2191us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":124,"threads_started":1}
W20260812 02:43:11.312273 27628 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:11.306426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:34849 (local address 127.10.75.126:34243)
0812 02:43:11.306579 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:11.306584 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:11.306742 (+ 158us) server_negotiation.cc:407] Connection header received
0812 02:43:11.306854 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:11.306856 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:11.306900 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:11.306975 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:11.307497 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:11.308032 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:11.308877 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:11.309094 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:11.309177 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:11.312161 (+ 2984us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.66:34849: BlockingRecv error: recv got EOF from 127.10.75.66:34849 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 12 02:43:11 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:11 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:11.499750 27633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:11.493383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.67:57073)
0812 02:43:11.493758 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:11.493775 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:11.493898 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:11.494229 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:11.494232 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:11.494460 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:11.494578 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:11.494585 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:11.495383 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:11.495388 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:11.496393 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:11.496404 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:11.496865 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:11.496868 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:11.496953 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:11.497622 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:11.497634 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:11.499543 (+ 1909us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":128,"threads_started":1}
W20260812 02:43:11.499765 27628 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:11.493591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:57073 (local address 127.10.75.126:34243)
0812 02:43:11.493750 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:11.493755 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:11.493837 (+ 82us) server_negotiation.cc:407] Connection header received
0812 02:43:11.494017 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:11.494022 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:11.494106 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:11.494196 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:11.494705 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:11.495266 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:11.496525 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:11.496753 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:11.496863 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:11.499665 (+ 2802us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.67:57073: BlockingRecv error: recv got EOF from 127.10.75.67:57073 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 12 02:43:12 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:12 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:12.139715 27635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:12.133692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.65:37373)
0812 02:43:12.134004 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:12.134027 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:12.134205 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:12.134485 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:12.134487 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:12.134674 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:12.134774 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:12.134779 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:12.135575 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:12.135578 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:12.136272 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:12.136283 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:12.136807 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:12.136811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:12.136903 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:12.137598 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:12.137611 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:12.139588 (+ 1977us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":91,"threads_started":1}
W20260812 02:43:12.139958 27637 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:12.133816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:37373 (local address 127.10.75.126:34243)
0812 02:43:12.134098 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:12.134101 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:12.134159 (+ 58us) server_negotiation.cc:407] Connection header received
0812 02:43:12.134292 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:12.134294 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:12.134338 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:12.134413 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:12.134919 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:12.135462 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:12.136382 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:12.136691 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:12.136769 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:12.139816 (+ 3047us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.65:37373: BlockingRecv error: recv got EOF from 127.10.75.65:37373 (error 108)
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":94,"threads_started":1}
Aug 12 02:43:12 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:12 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:12.318820 27642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:12.313085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.66:45803)
0812 02:43:12.313381 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:12.313395 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:12.313536 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:12.313789 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:12.313791 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:12.313972 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:12.314109 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:12.314115 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:12.314957 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:12.314960 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:12.315684 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:12.315694 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:12.316144 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:12.316147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:12.316204 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:12.316762 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:12.316774 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:12.318696 (+ 1922us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":113,"threads_started":1}
W20260812 02:43:12.318995 27637 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:12.313149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:45803 (local address 127.10.75.126:34243)
0812 02:43:12.313304 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:12.313308 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:12.313474 (+ 166us) server_negotiation.cc:407] Connection header received
0812 02:43:12.313620 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:12.313623 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:12.313680 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:12.313748 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:12.314213 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:12.314860 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:12.315784 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:12.316006 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:12.316129 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:12.318836 (+ 2707us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.66:45803: BlockingRecv error: recv got EOF from 127.10.75.66:45803 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 12 02:43:12 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:12 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:12.506543 27644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:12.500574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.67:48429)
0812 02:43:12.500849 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:12.500863 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:12.500966 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:12.501259 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:12.501261 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:12.501442 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:12.501538 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:12.501543 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:12.502347 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:12.502350 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:12.502915 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:12.502924 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:12.503408 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:12.503410 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:12.503472 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:12.504062 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:12.504076 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:12.506426 (+ 2350us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":76,"threads_started":1}
W20260812 02:43:12.506765 27637 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:12.500708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:48429 (local address 127.10.75.126:34243)
0812 02:43:12.500867 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:12.500870 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:12.500937 (+ 67us) server_negotiation.cc:407] Connection header received
0812 02:43:12.501091 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:12.501094 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:12.501145 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:12.501221 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:12.501652 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:12.502251 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:12.503054 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:12.503295 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:12.503402 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:12.506623 (+ 3221us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.67:48429: BlockingRecv error: recv got EOF from 127.10.75.67:48429 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 12 02:43:13 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:13 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:13.147316 27645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:13.140655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.65:33677)
0812 02:43:13.141058 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:13.141073 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:13.141218 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:13.141522 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:13.141525 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:13.141765 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:13.141896 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:13.141902 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:13.142782 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:13.142785 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:13.143559 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:13.143573 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:13.144218 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:13.144229 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:13.144331 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:13.145058 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:13.145071 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:13.147163 (+ 2092us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":143,"threads_started":1}
W20260812 02:43:13.147486 27648 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:13.140712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:33677 (local address 127.10.75.126:34243)
0812 02:43:13.141043 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:13.141047 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:13.141151 (+ 104us) server_negotiation.cc:407] Connection header received
0812 02:43:13.141310 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:13.141313 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:13.141367 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:13.141469 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:13.142010 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:13.142662 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:13.143705 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:13.144084 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:13.144197 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:13.147322 (+ 3125us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.65:33677: BlockingRecv error: recv got EOF from 127.10.75.65:33677 (error 108)
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":98,"threads_started":1}
Aug 12 02:43:13 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:13 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:13.326316 27649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:13.319683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.66:36667)
0812 02:43:13.320058 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:13.320073 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:13.320253 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:13.320603 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:13.320606 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:13.320911 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:13.321080 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:13.321091 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:13.322104 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:13.322108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:13.322739 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:13.322749 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:13.323244 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:13.323247 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:13.323313 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:13.323918 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:13.323930 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:13.326167 (+ 2237us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":120,"threads_started":1}
W20260812 02:43:13.326493 27648 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:13.319787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:36667 (local address 127.10.75.126:34243)
0812 02:43:13.320020 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:13.320024 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:13.320179 (+ 155us) server_negotiation.cc:407] Connection header received
0812 02:43:13.320383 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:13.320386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:13.320456 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:13.320554 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:13.321221 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:13.321970 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:13.322849 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:13.323141 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:13.323226 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:13.326334 (+ 3108us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.66:36667: BlockingRecv error: recv got EOF from 127.10.75.66:36667 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 12 02:43:13 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:13 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:13.514752 27651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:13.507678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.67:60263)
0812 02:43:13.508236 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:13.508251 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:13.508428 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:13.508929 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:13.508932 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:13.509247 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:13.509421 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:13.509430 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:13.510527 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:13.510533 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:13.511145 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:13.511154 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:13.511645 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:13.511649 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:13.511742 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:13.512356 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:13.512369 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:13.514547 (+ 2178us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":172,"threads_started":1}
W20260812 02:43:13.514835 27648 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:13.507834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:60263 (local address 127.10.75.126:34243)
0812 02:43:13.508148 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:13.508154 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:13.508347 (+ 193us) server_negotiation.cc:407] Connection header received
0812 02:43:13.508661 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:13.508667 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:13.508745 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:13.508890 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:13.509550 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:13.510415 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:13.511272 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:13.511525 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:13.511640 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:13.514700 (+ 3060us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.67:60263: BlockingRecv error: recv got EOF from 127.10.75.67:60263 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 12 02:43:14 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:14 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:14.159633 27652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:14.148322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.65:42017)
0812 02:43:14.148648 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:14.148664 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:14.148762 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:14.149113 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:14.149115 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:14.149341 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:14.149462 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:14.149468 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:14.150568 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:14.150571 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:14.151225 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:14.151236 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:14.151756 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:14.151758 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:14.151819 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:14.157173 (+ 5354us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:14.157193 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:14.159438 (+ 2245us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":107,"threads_started":1}
W20260812 02:43:14.159756 27654 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:14.148431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:42017 (local address 127.10.75.126:34243)
0812 02:43:14.148714 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:14.148717 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:14.148732 (+ 15us) server_negotiation.cc:407] Connection header received
0812 02:43:14.148887 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:14.148891 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:14.148943 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:14.149044 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:14.149633 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:14.150464 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:14.151372 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:14.151646 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:14.151737 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:14.159616 (+ 7879us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.65:42017: BlockingRecv error: recv got EOF from 127.10.75.65:42017 (error 108)
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":123,"threads_started":1}
Aug 12 02:43:14 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:14 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:14.333745 27656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:14.327310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.66:56487)
0812 02:43:14.327708 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:14.327727 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:14.327885 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:14.328196 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:14.328199 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:14.328434 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:14.328542 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:14.328556 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:14.329368 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:14.329373 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:14.329995 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:14.330004 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:14.330658 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:14.330663 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:14.330782 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:14.331446 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:14.331466 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:14.333528 (+ 2062us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":205,"threads_started":1}
W20260812 02:43:14.333758 27654 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:14.327524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:56487 (local address 127.10.75.126:34243)
0812 02:43:14.327700 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:14.327705 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:14.327817 (+ 112us) server_negotiation.cc:407] Connection header received
0812 02:43:14.328006 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:14.328010 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:14.328072 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:14.328166 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:14.328680 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:14.329250 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:14.330219 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:14.330502 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:14.330619 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:14.333667 (+ 3048us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.66:56487: BlockingRecv error: recv got EOF from 127.10.75.66:56487 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 12 02:43:14 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:14 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:14.521687 27657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:14.515755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.67:53449)
0812 02:43:14.516051 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:14.516064 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:14.516194 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:14.516590 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:14.516594 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:14.516867 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:14.517036 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:14.517049 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:14.517956 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:14.517959 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:14.518641 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:14.518651 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:14.519068 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:14.519071 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:14.519133 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:14.519659 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:14.519671 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:14.521553 (+ 1882us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":100,"threads_started":1}
W20260812 02:43:14.521924 27654 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:14.515808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:53449 (local address 127.10.75.126:34243)
0812 02:43:14.515950 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:14.515955 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:14.516144 (+ 189us) server_negotiation.cc:407] Connection header received
0812 02:43:14.516312 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:14.516316 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:14.516395 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:14.516482 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:14.517175 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:14.517844 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:14.518758 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:14.518966 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:14.519062 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:14.521800 (+ 2738us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.67:53449: BlockingRecv error: recv got EOF from 127.10.75.67:53449 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 12 02:43:15 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:15 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:15.167786 27658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:15.160700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.65:42981)
0812 02:43:15.161174 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:15.161190 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:15.161320 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:15.161620 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:15.161623 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:15.161902 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:15.162025 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:15.162031 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:15.162988 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:15.162990 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:15.163600 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:15.163610 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:15.164116 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:15.164120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:15.164215 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:15.165092 (+ 877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:15.165109 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:15.167622 (+ 2513us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":176,"threads_started":1}
W20260812 02:43:15.168010 27659 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:15.160813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:42981 (local address 127.10.75.126:34243)
0812 02:43:15.161240 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:15.161244 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:15.161262 (+ 18us) server_negotiation.cc:407] Connection header received
0812 02:43:15.161424 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:15.161427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:15.161481 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:15.161571 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:15.162241 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:15.162852 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:15.163712 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:15.163961 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:15.164048 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:15.167827 (+ 3779us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.65:42981: BlockingRecv error: recv got EOF from 127.10.75.65:42981 (error 108)
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":176,"threads_started":1}
Aug 12 02:43:15 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:15 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:15.341787 27662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:15.334825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.66:53123)
0812 02:43:15.335230 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:15.335256 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:15.335414 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:15.335730 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:15.335734 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:15.335984 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:15.336108 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:15.336113 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:15.336947 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:15.336950 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:15.337685 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:15.337696 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:15.338251 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:15.338254 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:15.338332 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:15.339122 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:15.339135 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:15.341638 (+ 2503us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":126,"threads_started":1}
W20260812 02:43:15.342082 27659 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:15.335036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:53123 (local address 127.10.75.126:34243)
0812 02:43:15.335234 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:15.335239 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:15.335361 (+ 122us) server_negotiation.cc:407] Connection header received
0812 02:43:15.335515 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:15.335518 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:15.335572 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:15.335650 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:15.336225 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:15.336817 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:15.337810 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:15.338099 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:15.338222 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:15.341786 (+ 3564us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.66:53123: BlockingRecv error: recv got EOF from 127.10.75.66:53123 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 12 02:43:15 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:15 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:15.529497 27663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:15.522913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.67:57623)
0812 02:43:15.523294 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:15.523313 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:15.523473 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:15.523890 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:15.523894 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:15.524212 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:15.524343 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:15.524351 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:15.525220 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:15.525224 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:15.525835 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:15.525844 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:15.526382 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:15.526385 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:15.526457 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:15.527162 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:15.527181 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:15.529339 (+ 2158us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":132,"threads_started":1}
W20260812 02:43:15.529857 27659 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:15.522912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:57623 (local address 127.10.75.126:34243)
0812 02:43:15.523136 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:15.523141 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:15.523410 (+ 269us) server_negotiation.cc:407] Connection header received
0812 02:43:15.523594 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:15.523597 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:15.523669 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:15.523777 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:15.524469 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:15.525087 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:15.525962 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:15.526277 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:15.526361 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:15.529516 (+ 3155us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.67:57623: BlockingRecv error: recv got EOF from 127.10.75.67:57623 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 12 02:43:16 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:16 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:16.174712 27664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:16.168789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.65:54377)
0812 02:43:16.169180 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:16.169194 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:16.169310 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:16.169616 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:16.169618 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:16.169831 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:16.169945 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:16.169950 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:16.170787 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:16.170790 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:16.171366 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:16.171374 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:16.171839 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:16.171841 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:16.171905 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:16.172571 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:16.172584 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:16.174582 (+ 1998us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":102,"threads_started":1}
W20260812 02:43:16.174916 27665 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:16.168854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:54377 (local address 127.10.75.126:34243)
0812 02:43:16.169180 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:16.169185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:16.169268 (+ 83us) server_negotiation.cc:407] Connection header received
0812 02:43:16.169401 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:16.169404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:16.169452 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:16.169537 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:16.170050 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:16.170661 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:16.171485 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:16.171733 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:16.171818 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:16.174753 (+ 2935us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.65:54377: BlockingRecv error: recv got EOF from 127.10.75.65:54377 (error 108)
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":134,"threads_started":1}
Aug 12 02:43:16 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:16 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:16.348577 27666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:16.342710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.66:44209)
0812 02:43:16.343105 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:16.343118 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:16.343257 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:16.343545 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:16.343548 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:16.343792 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:16.343893 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:16.343900 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:16.344680 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:16.344685 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:16.345267 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:16.345275 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:16.345745 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:16.345749 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:16.345833 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:16.346375 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:16.346387 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:16.348391 (+ 2004us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":105,"threads_started":1}
W20260812 02:43:16.348639 27665 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:16.342801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:44209 (local address 127.10.75.126:34243)
0812 02:43:16.342993 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:16.342999 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:16.343200 (+ 201us) server_negotiation.cc:407] Connection header received
0812 02:43:16.343368 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:16.343373 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:16.343427 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:16.343522 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:16.344015 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:16.344567 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:16.345391 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:16.345628 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:16.345739 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:16.348520 (+ 2781us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.66:44209: BlockingRecv error: recv got EOF from 127.10.75.66:44209 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 12 02:43:16 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:16 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:16.536609 27667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:16.530429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.67:51507)
0812 02:43:16.530799 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:16.530813 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:16.530986 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:16.531285 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:16.531287 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:16.531488 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:16.531596 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:16.531602 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:16.532390 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:16.532393 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:16.532957 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:16.532965 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:16.533412 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:16.533414 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:16.533479 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:16.534009 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:16.534021 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:16.536418 (+ 2397us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":94,"threads_started":1}
W20260812 02:43:16.536712 27665 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:16.530464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:51507 (local address 127.10.75.126:34243)
0812 02:43:16.530687 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:16.530692 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:16.530926 (+ 234us) server_negotiation.cc:407] Connection header received
0812 02:43:16.531114 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:16.531117 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:16.531165 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:16.531238 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:16.531730 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:16.532281 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:16.533082 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:16.533307 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:16.533388 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:16.536589 (+ 3201us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.67:51507: BlockingRecv error: recv got EOF from 127.10.75.67:51507 (error 108)
Metrics: {"server-negotiator.queue_time_us":130}
Aug 12 02:43:17 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:17 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:17.182659 27669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:17.175896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.65:34139)
0812 02:43:17.176342 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:17.176373 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:17.176533 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:17.176921 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:17.176925 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:17.177199 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:17.177323 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:17.177330 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:17.178332 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:17.178344 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:17.178947 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:17.178957 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:17.179464 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:17.179468 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:17.179565 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:17.180210 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:17.180223 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:17.182430 (+ 2207us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":124,"threads_started":1}
W20260812 02:43:17.182729 27671 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:17.176016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:34139 (local address 127.10.75.126:34243)
0812 02:43:17.176352 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:17.176358 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:17.176469 (+ 111us) server_negotiation.cc:407] Connection header received
0812 02:43:17.176657 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:17.176661 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:17.176739 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:17.176893 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:17.177460 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:17.178215 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:17.179075 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:17.179341 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:17.179456 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:17.182590 (+ 3134us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.65:34139: BlockingRecv error: recv got EOF from 127.10.75.65:34139 (error 108)
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":110,"threads_started":1}
Aug 12 02:43:17 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:17 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:17.356540 27673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:17.349720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.66:46925)
0812 02:43:17.350145 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:17.350161 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:17.350302 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:17.350614 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:17.350616 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:17.350858 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:17.350982 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:17.350988 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:17.352108 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:17.352112 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:17.352720 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:17.352729 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:17.353224 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:17.353227 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:17.353295 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:17.353924 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:17.353937 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:17.356377 (+ 2440us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":138,"threads_started":1}
W20260812 02:43:17.356737 27671 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:17.349784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:46925 (local address 127.10.75.126:34243)
0812 02:43:17.349990 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:17.349996 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:17.350249 (+ 253us) server_negotiation.cc:407] Connection header received
0812 02:43:17.350413 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:17.350416 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:17.350485 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:17.350562 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:17.351141 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:17.351961 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:17.352848 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:17.353107 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:17.353193 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:17.356567 (+ 3374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.66:46925: BlockingRecv error: recv got EOF from 127.10.75.66:46925 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 12 02:43:17 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:17 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:17.544556 27674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:17.537712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.67:42251)
0812 02:43:17.538221 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:17.538237 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:17.538376 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:17.538677 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:17.538680 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:17.538926 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:17.539067 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:17.539073 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:17.540051 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:17.540054 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:17.540640 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:17.540649 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:17.541226 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:17.541229 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:17.541337 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:17.542166 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:17.542183 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:17.544396 (+ 2213us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":167,"threads_started":1}
W20260812 02:43:17.544749 27671 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:17.537791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:42251 (local address 127.10.75.126:34243)
0812 02:43:17.537992 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:17.537998 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:17.538360 (+ 362us) server_negotiation.cc:407] Connection header received
0812 02:43:17.538489 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:17.538492 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:17.538558 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:17.538635 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:17.539229 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:17.539896 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:17.540758 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:17.541104 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:17.541229 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:17.544596 (+ 3367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.67:42251: BlockingRecv error: recv got EOF from 127.10.75.67:42251 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 12 02:43:18 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:18 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:18.190982 27675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:18.184000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.65:57399)
0812 02:43:18.184612 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:18.184633 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:18.184816 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:18.185204 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:18.185208 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:18.185570 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:18.185699 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:18.185707 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:18.186562 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:18.186565 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:18.187153 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:18.187161 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:18.187654 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:18.187657 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:18.187732 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:18.188364 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:18.188378 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:18.190820 (+ 2442us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":128,"threads_started":1}
W20260812 02:43:18.191139 27676 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:18.184145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:57399 (local address 127.10.75.126:34243)
0812 02:43:18.184453 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:18.184457 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:18.184733 (+ 276us) server_negotiation.cc:407] Connection header received
0812 02:43:18.184930 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:18.184935 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:18.185025 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:18.185135 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:18.185822 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:18.186458 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:18.187268 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:18.187516 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:18.187597 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:18.190983 (+ 3386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.65:57399: BlockingRecv error: recv got EOF from 127.10.75.65:57399 (error 108)
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":81,"threads_started":1}
Aug 12 02:43:18 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:18 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:18.364529 27677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:18.357888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.66:38927)
0812 02:43:18.358238 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:18.358261 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:18.358405 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:18.358724 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:18.358727 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:18.358994 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:18.359116 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:18.359122 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:18.359947 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:18.359949 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:18.360558 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:18.360566 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:18.361060 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:18.361063 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:18.361130 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:18.361770 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:18.361790 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:18.364253 (+ 2463us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":137,"threads_started":1}
W20260812 02:43:18.364614 27676 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:18.358021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:38927 (local address 127.10.75.126:34243)
0812 02:43:18.358239 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:18.358243 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:18.358333 (+ 90us) server_negotiation.cc:407] Connection header received
0812 02:43:18.358498 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:18.358501 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:18.358555 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:18.358632 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:18.359238 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:18.359822 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:18.360697 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:18.360953 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:18.361037 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:18.364427 (+ 3390us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.66:38927: BlockingRecv error: recv got EOF from 127.10.75.66:38927 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
Aug 12 02:43:18 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:18 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:18.555684 27679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:18.545594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.67:59001)
0812 02:43:18.545975 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:18.545991 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:18.546164 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:18.546438 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:18.546441 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:18.546677 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:18.546800 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:18.546806 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:18.547585 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:18.547587 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:18.548166 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:18.548174 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:18.548605 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:18.548608 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:18.548676 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:18.552932 (+ 4256us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:18.552947 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:18.555438 (+ 2491us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":138,"threads_started":1}
W20260812 02:43:18.555922 27676 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:18.545650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:59001 (local address 127.10.75.126:34243)
0812 02:43:18.545835 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:18.545841 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:18.546085 (+ 244us) server_negotiation.cc:407] Connection header received
0812 02:43:18.546253 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:18.546255 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:18.546314 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:18.546396 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:18.546903 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:18.547489 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:18.548265 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:18.548503 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:18.548581 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:18.555704 (+ 7123us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.67:59001: BlockingRecv error: recv got EOF from 127.10.75.67:59001 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 12 02:43:19 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:19 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:19.202883 27683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:19.191952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.65:43903)
0812 02:43:19.192277 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:19.192291 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:19.192385 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:19.192656 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:19.192658 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:19.192869 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:19.192983 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:19.192988 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:19.193832 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:19.193834 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:19.194502 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:19.194550 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:19.194987 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:19.194990 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:19.195055 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:19.200451 (+ 5396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:19.200464 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:19.202735 (+ 2271us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":123,"threads_started":1}
W20260812 02:43:19.203035 27685 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:19.192054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:43903 (local address 127.10.75.126:34243)
0812 02:43:19.192331 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:19.192334 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:19.192348 (+ 14us) server_negotiation.cc:407] Connection header received
0812 02:43:19.192477 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:19.192480 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:19.192529 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:19.192601 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:19.193109 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:19.193722 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:19.194662 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:19.194888 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:19.194969 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:19.202885 (+ 7916us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.65:43903: BlockingRecv error: recv got EOF from 127.10.75.65:43903 (error 108)
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":101,"threads_started":1}
Aug 12 02:43:19 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:19 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:19.371482 27688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:19.365458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.66:59311)
0812 02:43:19.365765 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:19.365779 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:19.365879 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:19.366186 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:19.366189 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:19.366393 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:19.366504 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:19.366510 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:19.367278 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:19.367281 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:19.367878 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:19.367888 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:19.368361 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:19.368364 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:19.368430 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:19.369033 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:19.369045 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:19.371362 (+ 2317us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":111,"threads_started":1}
W20260812 02:43:19.371668 27685 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:19.365500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:59311 (local address 127.10.75.126:34243)
0812 02:43:19.365657 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:19.365661 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:19.365854 (+ 193us) server_negotiation.cc:407] Connection header received
0812 02:43:19.365964 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:19.365966 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:19.366011 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:19.366125 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:19.366631 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:19.367168 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:19.368016 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:19.368248 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:19.368331 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:19.371503 (+ 3172us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.66:59311: BlockingRecv error: recv got EOF from 127.10.75.66:59311 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 12 02:43:19 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:19 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:19.562613 27690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:19.556511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.67:33881)
0812 02:43:19.556854 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:19.556873 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:19.557027 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:19.557308 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:19.557311 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:19.557559 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:19.557672 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:19.557679 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:19.558635 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:19.558640 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:19.559223 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:19.559235 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:19.559710 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:19.559714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:19.559805 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:19.560347 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:19.560360 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:19.562416 (+ 2056us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":115,"threads_started":1}
W20260812 02:43:19.562645 27685 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:19.556689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:33881 (local address 127.10.75.126:34243)
0812 02:43:19.556852 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:19.556857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:19.556964 (+ 107us) server_negotiation.cc:407] Connection header received
0812 02:43:19.557132 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:19.557136 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:19.557191 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:19.557280 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:19.557800 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:19.558517 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:19.559355 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:19.559587 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:19.559702 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:19.562543 (+ 2841us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.67:33881: BlockingRecv error: recv got EOF from 127.10.75.67:33881 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 12 02:43:20 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:20 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:20.210364 27693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:20.203877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.65:37665)
0812 02:43:20.204182 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:20.204196 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:20.204294 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:20.204534 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:20.204536 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:20.204727 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:20.204827 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:20.204832 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:20.205715 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:20.205718 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:20.206600 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:20.206613 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:20.207305 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:20.207310 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:20.207412 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:20.208039 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:20.208052 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:20.210186 (+ 2134us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":118,"threads_started":1}
W20260812 02:43:20.210420 27694 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:20.203944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:37665 (local address 127.10.75.126:34243)
0812 02:43:20.204219 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:20.204223 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:20.204241 (+ 18us) server_negotiation.cc:407] Connection header received
0812 02:43:20.204375 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:20.204377 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:20.204420 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:20.204517 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:20.204968 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:20.205577 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:20.206772 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:20.207119 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:20.207242 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:20.210291 (+ 3049us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.65:37665: BlockingRecv error: recv got EOF from 127.10.75.65:37665 (error 108)
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":113,"threads_started":1}
Aug 12 02:43:20 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:20 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:20.378252 27696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:20.372287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.66:38063)
0812 02:43:20.372724 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:20.372737 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:20.372873 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:20.373152 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:20.373155 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:20.373384 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:20.373476 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:20.373481 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:20.374356 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:20.374362 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:20.374920 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:20.374928 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:20.375397 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:20.375400 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:20.375485 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:20.376025 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:20.376036 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:20.378033 (+ 1997us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":150,"threads_started":1}
W20260812 02:43:20.378293 27694 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:20.372403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:38063 (local address 127.10.75.126:34243)
0812 02:43:20.372597 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:20.372603 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:20.372825 (+ 222us) server_negotiation.cc:407] Connection header received
0812 02:43:20.372980 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:20.372987 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:20.373031 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:20.373124 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:20.373662 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:20.374247 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:20.375046 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:20.375279 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:20.375391 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:20.378192 (+ 2801us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.66:38063: BlockingRecv error: recv got EOF from 127.10.75.66:38063 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 12 02:43:20 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:20 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:20.569478 27697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:20.563528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.67:37137)
0812 02:43:20.563894 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:20.563907 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:20.564009 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:20.564358 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:20.564361 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:20.564570 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:20.564684 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:20.564690 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:20.565435 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:20.565438 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:20.565994 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:20.566002 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:20.566527 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:20.566531 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:20.566627 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:20.567248 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:20.567263 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:20.569305 (+ 2042us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":144,"threads_started":1}
W20260812 02:43:20.569545 27694 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:20.563601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:37137 (local address 127.10.75.126:34243)
0812 02:43:20.563778 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:20.563782 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:20.563981 (+ 199us) server_negotiation.cc:407] Connection header received
0812 02:43:20.564141 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:20.564145 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:20.564197 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:20.564277 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:20.564808 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:20.565333 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:20.566174 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:20.566389 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:20.566508 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:20.569435 (+ 2927us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.67:37137: BlockingRecv error: recv got EOF from 127.10.75.67:37137 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 12 02:43:21 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:21 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:21.219003 27701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:21.211493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.65:57671)
0812 02:43:21.211875 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:21.211904 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:21.212051 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:21.212349 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:21.212351 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:21.212610 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:21.212744 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:21.212752 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:21.213877 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:21.213881 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:21.214918 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:21.214933 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:21.215531 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:21.215536 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:21.215627 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:21.216364 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:21.216378 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:21.218847 (+ 2469us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":133,"threads_started":1}
W20260812 02:43:21.219250 27704 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:21.211544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:57671 (local address 127.10.75.126:34243)
0812 02:43:21.211884 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:21.211888 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:21.211997 (+ 109us) server_negotiation.cc:407] Connection header received
0812 02:43:21.212147 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:21.212150 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:21.212204 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:21.212308 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:21.212913 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:21.213710 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:21.215082 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:21.215368 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:21.215512 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:21.219037 (+ 3525us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.65:57671: BlockingRecv error: recv got EOF from 127.10.75.65:57671 (error 108)
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":111,"threads_started":1}
Aug 12 02:43:21 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:21 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:21.386036 27706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:21.379396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.66:39425)
0812 02:43:21.379752 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:21.379772 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:21.379925 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:21.380317 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:21.380320 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:21.380629 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:21.380791 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:21.380821 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:21.381700 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:21.381703 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:21.382370 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:21.382380 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:21.382864 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:21.382867 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:21.382935 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:21.383634 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:21.383658 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:21.385889 (+ 2231us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":110,"threads_started":1}
W20260812 02:43:21.386267 27704 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:21.379463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:39425 (local address 127.10.75.126:34243)
0812 02:43:21.379686 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:21.379693 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:21.379870 (+ 177us) server_negotiation.cc:407] Connection header received
0812 02:43:21.380048 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:21.380054 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:21.380148 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:21.380244 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:21.380952 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:21.381574 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:21.382492 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:21.382737 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:21.382830 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:21.386116 (+ 3286us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.66:39425: BlockingRecv error: recv got EOF from 127.10.75.66:39425 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 12 02:43:21 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:21 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:21.577248 27707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:21.570619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.67:34215)
0812 02:43:21.570976 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:21.570998 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:21.571172 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:21.571509 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:21.571513 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:21.571779 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:21.571901 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:21.571908 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:21.572759 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:21.572764 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:21.573353 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:21.573361 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:21.573867 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:21.573871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:21.573971 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:21.574740 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:21.574752 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:21.577102 (+ 2350us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":127,"threads_started":1}
W20260812 02:43:21.577569 27704 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:21.570694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:34215 (local address 127.10.75.126:34243)
0812 02:43:21.570891 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:21.570896 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:21.571119 (+ 223us) server_negotiation.cc:407] Connection header received
0812 02:43:21.571296 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:21.571299 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:21.571371 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:21.571476 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:21.572035 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:21.572639 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:21.573491 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:21.573745 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:21.573861 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:21.577280 (+ 3419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.67:34215: BlockingRecv error: recv got EOF from 127.10.75.67:34215 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 12 02:43:22 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:22 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:22.226526 27711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:22.219914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.65:49891)
0812 02:43:22.220395 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:22.220413 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:22.220576 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:22.220857 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:22.220859 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:22.221081 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:22.221204 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:22.221209 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:22.222260 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:22.222264 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:22.223027 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:22.223038 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:22.223528 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:22.223531 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:22.223644 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:22.224265 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:22.224278 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:22.226387 (+ 2109us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":102,"threads_started":1}
W20260812 02:43:22.226756 27713 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:22.219970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:49891 (local address 127.10.75.126:34243)
0812 02:43:22.220302 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:22.220306 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:22.220516 (+ 210us) server_negotiation.cc:407] Connection header received
0812 02:43:22.220674 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:22.220677 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:22.220733 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:22.220817 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:22.221336 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:22.222143 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:22.223146 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:22.223414 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:22.223519 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:22.226529 (+ 3010us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.65:49891: BlockingRecv error: recv got EOF from 127.10.75.65:49891 (error 108)
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":83,"threads_started":1}
Aug 12 02:43:22 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:22 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:22.393124 27714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:22.387120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.66:59477)
0812 02:43:22.387438 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:22.387451 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:22.387555 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:22.387794 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:22.387797 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:22.387998 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:22.388121 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:22.388127 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:22.388935 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:22.388938 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:22.389526 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:22.389539 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:22.390017 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:22.390019 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:22.390120 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:22.390680 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:22.390692 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:22.392933 (+ 2241us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":125,"threads_started":1}
W20260812 02:43:22.393163 27713 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:22.387270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:59477 (local address 127.10.75.126:34243)
0812 02:43:22.387419 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:22.387423 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:22.387520 (+ 97us) server_negotiation.cc:407] Connection header received
0812 02:43:22.387637 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:22.387640 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:22.387684 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:22.387755 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:22.388257 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:22.388824 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:22.389680 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:22.389912 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:22.390001 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:22.393062 (+ 3061us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.66:59477: BlockingRecv error: recv got EOF from 127.10.75.66:59477 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 12 02:43:22 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:22 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:22.584043 27716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:22.578262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.67:37179)
0812 02:43:22.578637 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:22.578650 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:22.578790 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:22.579092 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:22.579095 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:22.579330 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:22.579436 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:22.579443 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:22.580253 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:22.580258 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:22.580858 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:22.580867 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:22.581339 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:22.581342 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:22.581430 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:22.581955 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:22.581967 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:22.583852 (+ 1885us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":117,"threads_started":1}
W20260812 02:43:22.584120 27713 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:22.578322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:37179 (local address 127.10.75.126:34243)
0812 02:43:22.578498 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:22.578503 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:22.578737 (+ 234us) server_negotiation.cc:407] Connection header received
0812 02:43:22.578904 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:22.578908 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:22.578965 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:22.579062 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:22.579570 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:22.580131 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:22.580984 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:22.581221 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:22.581334 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:22.583985 (+ 2651us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.67:37179: BlockingRecv error: recv got EOF from 127.10.75.67:37179 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 02:43:23 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:23 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:23.234022 27718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:23.227446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.65:32805)
0812 02:43:23.227809 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:23.227824 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:23.227943 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:23.228227 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:23.228229 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:23.228468 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:23.228592 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:23.228598 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:23.229437 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:23.229441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:23.230106 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:23.230119 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:23.230585 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:23.230588 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:23.230672 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:23.231325 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:23.231338 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:23.233868 (+ 2530us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":134,"threads_started":1}
W20260812 02:43:23.234223 27719 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:23.227519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:32805 (local address 127.10.75.126:34243)
0812 02:43:23.227867 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:23.227871 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:23.227885 (+ 14us) server_negotiation.cc:407] Connection header received
0812 02:43:23.228037 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:23.228040 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:23.228094 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:23.228182 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:23.228700 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:23.229312 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:23.230224 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:23.230477 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:23.230559 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:23.234044 (+ 3485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.65:32805: BlockingRecv error: recv got EOF from 127.10.75.65:32805 (error 108)
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":97,"threads_started":1}
Aug 12 02:43:23 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:23 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:23.400976 27722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:23.394238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.66:45461)
0812 02:43:23.394690 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:23.394706 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:23.394848 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:23.395179 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:23.395182 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:23.395446 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:23.395571 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:23.395578 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:23.396448 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:23.396452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:23.397068 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:23.397079 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:23.397540 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:23.397543 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:23.397615 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:23.398373 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:23.398390 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:23.400746 (+ 2356us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":187,"threads_started":1}
W20260812 02:43:23.401016 27719 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:23.394312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:45461 (local address 127.10.75.126:34243)
0812 02:43:23.394519 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:23.394524 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:23.394828 (+ 304us) server_negotiation.cc:407] Connection header received
0812 02:43:23.394968 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:23.394971 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:23.395034 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:23.395115 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:23.395693 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:23.396287 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:23.397188 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:23.397423 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:23.397503 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:23.400893 (+ 3390us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.66:45461: BlockingRecv error: recv got EOF from 127.10.75.66:45461 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 12 02:43:23 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:23 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.67@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:23.591518 27724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:23.585140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.67:50955)
0812 02:43:23.585564 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:23.585580 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:23.585715 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:23.586017 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:23.586019 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:23.586281 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:23.586409 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:23.586415 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:23.587214 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:23.587216 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:23.587818 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:23.587826 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:23.588272 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:23.588275 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:23.588347 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:23.588952 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:23.588964 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:23.591296 (+ 2332us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":167,"threads_started":1}
W20260812 02:43:23.591661 27719 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:23.585226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:50955 (local address 127.10.75.126:34243)
0812 02:43:23.585429 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:23.585449 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:23.585669 (+ 220us) server_negotiation.cc:407] Connection header received
0812 02:43:23.585814 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:23.585817 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:23.585876 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:23.585958 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:23.586525 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:23.587114 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:23.587935 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:23.588170 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:23.588250 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:23.591517 (+ 3267us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.67:50955: BlockingRecv error: recv got EOF from 127.10.75.67:50955 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 12 02:43:24 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:24 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.65@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:24.248991 27725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:24.235312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.65:40465)
0812 02:43:24.235704 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:24.235720 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:24.235843 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:24.236191 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:24.236193 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:24.236452 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:24.236580 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:24.236586 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:24.237930 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:24.237937 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:24.238646 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:24.238659 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:24.239264 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:24.239267 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:24.239356 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:24.246408 (+ 7052us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:24.246425 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:24.248728 (+ 2303us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":156,"threads_started":1}
W20260812 02:43:24.249249 27726 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:24.235479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:40465 (local address 127.10.75.126:34243)
0812 02:43:24.235796 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:24.235800 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:24.235819 (+ 19us) server_negotiation.cc:407] Connection header received
0812 02:43:24.235985 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:24.235988 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:24.236047 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:24.236144 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:24.236730 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:24.237775 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:24.238843 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:24.239134 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:24.239230 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:24.249005 (+ 9775us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.65:40465: BlockingRecv error: recv got EOF from 127.10.75.65:40465 (error 108)
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":119,"threads_started":1}
Aug 12 02:43:24 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 02:43:24 dist-test-slave-2p8l krb5kdc[25806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.75.66@KRBTEST.COM for oryx/127.10.75.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 02:43:24.408572 27730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:24.402105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:34243 (local address 127.10.75.66:55215)
0812 02:43:24.402586 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:24.402606 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:24.402750 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:24.403095 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:24.403099 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:24.403363 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:24.403483 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:24.403490 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:24.404318 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:24.404322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:24.404962 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:24.404971 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:24.405474 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:24.405478 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:24.405566 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:24.406269 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:24.406281 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:24.408344 (+ 2063us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.75.126:34243: Server oryx/127.10.75.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":146,"threads_started":1}
W20260812 02:43:24.408604 27726 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:24.402185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:55215 (local address 127.10.75.126:34243)
0812 02:43:24.402375 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:24.402381 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:24.402691 (+ 310us) server_negotiation.cc:407] Connection header received
0812 02:43:24.402879 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:24.402882 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:24.402959 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:24.403062 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:24.403604 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:24.404202 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:24.405092 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:24.405352 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:24.405468 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:24.408486 (+ 3018us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.75.66:55215: BlockingRecv error: recv got EOF from 127.10.75.66:55215 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 02:43:24.472167 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 26877
I20260812 02:43:24.494310 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 27125
I20260812 02:43:24.510878 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 27377
I20260812 02:43:24.532496 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 26749
2026-08-12T02:43:24Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18432 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T02:43:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:43:24Z Disabled control of system clock
I20260812 02:43:24.586457 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:36325
--webserver_interface=127.10.75.126
--webserver_port=0
--builtin_ntp_servers=127.10.75.84:37531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:36325
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 02:43:24.722432 27738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:24.722767 27738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:24.722821 27738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:24.727275 27738 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:43:24.727375 27738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:24.727391 27738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:24.727409 27738 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:43:24.727486 27738 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:43:24.732635 27738 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:37531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:36325
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:36325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:24.734189 27738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:24.736066 27738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:24.746079 27748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:24.746099 27746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:24.746127 27745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:24.746356 27738 server_base.cc:1034] running on GCE node
I20260812 02:43:24.747112 27738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:24.748407 27738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:24.749577 27738 hybrid_clock.cc:648] HybridClock initialized: now 1786502604749564 us; error 33 us; skew 500 ppm
I20260812 02:43:24.751866 27738 webserver.cc:460] Webserver started at http://127.10.75.126:38579/ using document root <none> and password file <none>
I20260812 02:43:24.752540 27738 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:24.752606 27738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:24.752811 27738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:24.755393 27738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "2c0df5dac5cd48a89fa9ee75999b697c"
format_stamp: "Formatted at 2026-08-12 02:43:24 on dist-test-slave-2p8l"
server_key: "4f16ea63ba983fe787ceb7482e96f1a1"
server_key_iv: "173f48a3eccb946dd1c2393ba85907f4"
server_key_version: "encryptionkey@0"
I20260812 02:43:24.756019 27738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "2c0df5dac5cd48a89fa9ee75999b697c"
format_stamp: "Formatted at 2026-08-12 02:43:24 on dist-test-slave-2p8l"
server_key: "4f16ea63ba983fe787ceb7482e96f1a1"
server_key_iv: "173f48a3eccb946dd1c2393ba85907f4"
server_key_version: "encryptionkey@0"
I20260812 02:43:24.760565 27738 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 02:43:24.763516 27757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:24.765084 27738 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 02:43:24.765206 27738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "2c0df5dac5cd48a89fa9ee75999b697c"
format_stamp: "Formatted at 2026-08-12 02:43:24 on dist-test-slave-2p8l"
server_key: "4f16ea63ba983fe787ceb7482e96f1a1"
server_key_iv: "173f48a3eccb946dd1c2393ba85907f4"
server_key_version: "encryptionkey@0"
I20260812 02:43:24.765314 27738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:24.789321 27738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:24.790314 27738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:24.790508 27738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:24.799154 27738 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:36325
I20260812 02:43:24.799203 27848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:36325 every 8 connection(s)
I20260812 02:43:24.800364 27738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:43:24.804575 27851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:24.804616 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 27738
I20260812 02:43:24.804741 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:43:24.805119 10541 external_mini_cluster.cc:1428] Setting key 653cc04990b215cdade49d6204bcdb8b
I20260812 02:43:24.812496 27851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c: Bootstrap starting.
I20260812 02:43:24.815352 27851 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:24.815944 27854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:24.806980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37228 (local address 127.10.75.126:36325)
0812 02:43:24.807757 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:24.807774 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:24.807816 (+ 42us) server_negotiation.cc:407] Connection header received
0812 02:43:24.808623 (+ 807us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:24.808643 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:24.809103 (+ 460us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:24.809504 (+ 401us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:24.809999 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:24.811118 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:24.812116 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:24.812631 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:24.812846 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:24.813864 (+ 1018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:24.813869 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:24.813883 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:43:24.814398 (+ 515us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:24.814460 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:43:24.814483 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:24.814600 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:24.814725 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 02:43:24.815028 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":156,"threads_started":1}
I20260812 02:43:24.816380 27851 log.cc:824] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c: Log is configured to *not* fsync() on all Append() calls
I20260812 02:43:24.818900 27851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c: No bootstrap required, opened a new log
I20260812 02:43:24.823091 27851 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0df5dac5cd48a89fa9ee75999b697c" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36325 } }
I20260812 02:43:24.823339 27851 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:24.823375 27851 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0df5dac5cd48a89fa9ee75999b697c, State: Initialized, Role: FOLLOWER
I20260812 02:43:24.823869 27851 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0df5dac5cd48a89fa9ee75999b697c" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36325 } }
I20260812 02:43:24.824011 27851 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:43:24.824056 27851 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:43:24.824139 27851 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:24.825237 27851 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0df5dac5cd48a89fa9ee75999b697c" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36325 } }
I20260812 02:43:24.825608 27851 leader_election.cc:302] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c0df5dac5cd48a89fa9ee75999b697c; no voters:
I20260812 02:43:24.826102 27851 leader_election.cc:288] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:43:24.826294 27857 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:43:24.826561 27857 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c [term 1 LEADER]: Becoming Leader. State: Replica: 2c0df5dac5cd48a89fa9ee75999b697c, State: Running, Role: LEADER
I20260812 02:43:24.827214 27857 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0df5dac5cd48a89fa9ee75999b697c" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36325 } }
I20260812 02:43:24.827776 27851 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:43:24.829394 27858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c0df5dac5cd48a89fa9ee75999b697c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0df5dac5cd48a89fa9ee75999b697c" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36325 } } }
I20260812 02:43:24.829660 27858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c [sys.catalog]: This master's current role is: LEADER
I20260812 02:43:24.829434 27859 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c0df5dac5cd48a89fa9ee75999b697c. Latest consensus state: current_term: 1 leader_uuid: "2c0df5dac5cd48a89fa9ee75999b697c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0df5dac5cd48a89fa9ee75999b697c" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36325 } } }
I20260812 02:43:24.829824 27859 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c [sys.catalog]: This master's current role is: LEADER
W20260812 02:43:24.834499 27881 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:43:24.834625 27881 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:43:24.834705 27876 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:43:24.835597 27876 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:43:24.842984 27876 catalog_manager.cc:1347] Generated new cluster ID: 04e2daa239934a6aac36eb567c7d43c4
I20260812 02:43:24.843103 27876 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:43:24.858453 27876 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:43:24.859663 27876 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:43:24.866369 27876 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c0df5dac5cd48a89fa9ee75999b697c: Generated new TSK 0
I20260812 02:43:24.867426 27876 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:43:24.881707 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:36325
--builtin_ntp_servers=127.10.75.84:37531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 02:43:25.055701 27889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:25.056094 27889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:25.056144 27889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:25.061079 27889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:25.061172 27889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:25.061236 27889 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:43:25.066622 27889 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:37531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:36325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:25.068193 27889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:25.070209 27889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:25.082933 27904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:25.082938 27901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:25.084079 27889 server_base.cc:1034] running on GCE node
W20260812 02:43:25.084350 27902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:25.084970 27889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:25.085834 27889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:25.089193 27889 hybrid_clock.cc:648] HybridClock initialized: now 1786502605089130 us; error 89 us; skew 500 ppm
I20260812 02:43:25.091861 27889 webserver.cc:460] Webserver started at http://127.10.75.65:37119/ using document root <none> and password file <none>
I20260812 02:43:25.092602 27889 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:25.092707 27889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:25.092975 27889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:25.095448 27889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "755ee6c0f7a14947b3d54f92158af5dd"
format_stamp: "Formatted at 2026-08-12 02:43:25 on dist-test-slave-2p8l"
server_key: "0a94e7f3f8eda923d905cc36542447a6"
server_key_iv: "c75ad8dba9f62873b8a40d282afc82dd"
server_key_version: "encryptionkey@0"
I20260812 02:43:25.096084 27889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "755ee6c0f7a14947b3d54f92158af5dd"
format_stamp: "Formatted at 2026-08-12 02:43:25 on dist-test-slave-2p8l"
server_key: "0a94e7f3f8eda923d905cc36542447a6"
server_key_iv: "c75ad8dba9f62873b8a40d282afc82dd"
server_key_version: "encryptionkey@0"
I20260812 02:43:25.100258 27889 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 02:43:25.103183 27913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:25.104552 27889 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:43:25.104703 27889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "755ee6c0f7a14947b3d54f92158af5dd"
format_stamp: "Formatted at 2026-08-12 02:43:25 on dist-test-slave-2p8l"
server_key: "0a94e7f3f8eda923d905cc36542447a6"
server_key_iv: "c75ad8dba9f62873b8a40d282afc82dd"
server_key_version: "encryptionkey@0"
I20260812 02:43:25.104827 27889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:25.119729 27889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:25.120467 27889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:25.120690 27889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:25.121356 27889 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:43:25.122505 27889 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:43:25.122583 27889 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:25.122656 27889 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:43:25.122709 27889 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:25.133050 27889 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:32941
I20260812 02:43:25.133071 28120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:32941 every 8 connection(s)
I20260812 02:43:25.134048 27889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:43:25.143878 27854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:25.136066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:55617 (local address 127.10.75.126:36325)
0812 02:43:25.136222 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:25.136226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:25.137343 (+ 1117us) server_negotiation.cc:407] Connection header received
0812 02:43:25.138818 (+ 1475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:25.138822 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:25.138889 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:25.138998 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:25.139966 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:25.140552 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:25.141724 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:25.141968 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:25.142114 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:25.143332 (+ 1218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:25.143336 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:25.143339 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:43:25.143353 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:25.143383 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:43:25.143392 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:25.143477 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:25.143650 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 02:43:25.143720 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 02:43:25.144088 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 27889
I20260812 02:43:25.144232 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:43:25.144583 10541 external_mini_cluster.cc:1428] Setting key 20becdd9d2c78309f32fe61c7e0e6d8c
I20260812 02:43:25.144971 28124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:25.136426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:36325 (local address 127.10.75.65:55617)
0812 02:43:25.137183 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:25.137227 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:25.138575 (+ 1348us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:25.139184 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:25.139191 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:25.139297 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:25.139810 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:25.139823 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:25.140688 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:25.140696 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:25.141587 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:25.141596 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:25.142160 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:25.142164 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:25.142371 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:25.143053 (+ 682us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:43:25.143054 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:25.143094 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:43:25.143166 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:43:25.143480 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:43:25.143492 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:43:25.143501 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 02:43:25.143649 (+ 148us) client_negotiation.cc:240] Negotiation successful
0812 02:43:25.143929 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":124,"threads_started":1}
I20260812 02:43:25.146438 28122 heartbeater.cc:347] Connected to a master server at 127.10.75.126:36325
I20260812 02:43:25.146708 28122 heartbeater.cc:464] Registering TS with master...
I20260812 02:43:25.146725 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:36325
--builtin_ntp_servers=127.10.75.84:37531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 02:43:25.147264 28122 heartbeater.cc:511] Master 127.10.75.126:36325 requested a full tablet report, sending...
I20260812 02:43:25.148845 27794 ts_manager.cc:194] Registered new tserver with Master: 755ee6c0f7a14947b3d54f92158af5dd (127.10.75.65:32941)
I20260812 02:43:25.150123 27794 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.75.65:55617
W20260812 02:43:25.268242 28125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:25.268514 28125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:25.268584 28125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:25.272727 28125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:25.272805 28125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:25.272884 28125 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:43:25.277529 28125 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:37531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:36325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:25.278646 28125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:25.280009 28125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:25.289693 28143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:25.289693 28149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:25.289729 28142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:25.290102 28125 server_base.cc:1034] running on GCE node
I20260812 02:43:25.290536 28125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:25.291241 28125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:25.292411 28125 hybrid_clock.cc:648] HybridClock initialized: now 1786502605292391 us; error 30 us; skew 500 ppm
I20260812 02:43:25.294456 28125 webserver.cc:460] Webserver started at http://127.10.75.66:40733/ using document root <none> and password file <none>
I20260812 02:43:25.295055 28125 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:25.295127 28125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:25.295404 28125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:25.297519 28125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "ac2072803ae549dca39608a87d79d6f8"
format_stamp: "Formatted at 2026-08-12 02:43:25 on dist-test-slave-2p8l"
server_key: "c92591587e74ac2a477827f66148a9ca"
server_key_iv: "0c55bb651c143cc36982fd91176da4c3"
server_key_version: "encryptionkey@0"
I20260812 02:43:25.298185 28125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "ac2072803ae549dca39608a87d79d6f8"
format_stamp: "Formatted at 2026-08-12 02:43:25 on dist-test-slave-2p8l"
server_key: "c92591587e74ac2a477827f66148a9ca"
server_key_iv: "0c55bb651c143cc36982fd91176da4c3"
server_key_version: "encryptionkey@0"
I20260812 02:43:25.301949 28125 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:43:25.304567 28161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:25.305828 28125 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:43:25.305986 28125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "ac2072803ae549dca39608a87d79d6f8"
format_stamp: "Formatted at 2026-08-12 02:43:25 on dist-test-slave-2p8l"
server_key: "c92591587e74ac2a477827f66148a9ca"
server_key_iv: "0c55bb651c143cc36982fd91176da4c3"
server_key_version: "encryptionkey@0"
I20260812 02:43:25.306169 28125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:25.323939 28125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:25.324709 28125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:25.324927 28125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:25.325577 28125 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:43:25.326854 28125 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:43:25.326916 28125 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:25.327004 28125 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:43:25.327067 28125 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:25.336218 28125 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:38117
I20260812 02:43:25.336288 28363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:38117 every 8 connection(s)
I20260812 02:43:25.337141 28125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:43:25.344820 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 28125
I20260812 02:43:25.344909 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:43:25.345188 10541 external_mini_cluster.cc:1428] Setting key e30fbb72545e86006d520ddc4b6283e0
I20260812 02:43:25.346554 27854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:25.339010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:58997 (local address 127.10.75.126:36325)
0812 02:43:25.339148 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:25.339152 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:25.340176 (+ 1024us) server_negotiation.cc:407] Connection header received
0812 02:43:25.341597 (+ 1421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:25.341600 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:25.341659 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:25.341774 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:25.342747 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:25.343281 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:25.344404 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:25.344632 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:25.344756 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:25.346001 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:25.346004 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:25.346009 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:43:25.346025 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:25.346044 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:43:25.346052 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:25.346170 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:25.346348 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 02:43:25.346414 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 02:43:25.347133 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:36325
--builtin_ntp_servers=127.10.75.84:37531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 02:43:25.347427 28366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:25.339406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:36325 (local address 127.10.75.66:58997)
0812 02:43:25.340025 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:25.340064 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:25.341387 (+ 1323us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:25.341944 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:25.341950 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:25.342029 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:25.342550 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:25.342562 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:25.343416 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:25.343419 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:25.344264 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:25.344273 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:25.344793 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:25.344797 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:25.345054 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:25.345724 (+ 670us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:43:25.345726 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:25.345775 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:43:25.345850 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:43:25.346172 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:43:25.346191 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:43:25.346196 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 02:43:25.346333 (+ 137us) client_negotiation.cc:240] Negotiation successful
0812 02:43:25.346593 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":103,"threads_started":1}
I20260812 02:43:25.348527 28364 heartbeater.cc:347] Connected to a master server at 127.10.75.126:36325
I20260812 02:43:25.348760 28364 heartbeater.cc:464] Registering TS with master...
I20260812 02:43:25.349306 28364 heartbeater.cc:511] Master 127.10.75.126:36325 requested a full tablet report, sending...
I20260812 02:43:25.350575 27794 ts_manager.cc:194] Registered new tserver with Master: ac2072803ae549dca39608a87d79d6f8 (127.10.75.66:38117)
I20260812 02:43:25.351509 27794 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.75.66:58997
W20260812 02:43:25.463370 28367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:25.463603 28367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:25.463639 28367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:25.467515 28367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:25.467566 28367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:25.467615 28367 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:43:25.472201 28367 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:37531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:36325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:25.473070 28367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:25.474730 28367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:25.484078 28375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:25.484088 28376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:25.484105 28383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:25.484352 28367 server_base.cc:1034] running on GCE node
I20260812 02:43:25.484929 28367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:25.485642 28367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:25.486888 28367 hybrid_clock.cc:648] HybridClock initialized: now 1786502605486874 us; error 35 us; skew 500 ppm
I20260812 02:43:25.488935 28367 webserver.cc:460] Webserver started at http://127.10.75.67:39981/ using document root <none> and password file <none>
I20260812 02:43:25.489558 28367 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:25.489629 28367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:25.489869 28367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:25.492082 28367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "adfb97e2d44349a692b9fa41cf288fe4"
format_stamp: "Formatted at 2026-08-12 02:43:25 on dist-test-slave-2p8l"
server_key: "db94ca8658b43b78c3047cc43de4777c"
server_key_iv: "646963774d2a56f1865b1f65b44de63c"
server_key_version: "encryptionkey@0"
I20260812 02:43:25.492713 28367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "adfb97e2d44349a692b9fa41cf288fe4"
format_stamp: "Formatted at 2026-08-12 02:43:25 on dist-test-slave-2p8l"
server_key: "db94ca8658b43b78c3047cc43de4777c"
server_key_iv: "646963774d2a56f1865b1f65b44de63c"
server_key_version: "encryptionkey@0"
I20260812 02:43:25.496703 28367 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260812 02:43:25.499420 28394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:25.500689 28367 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:43:25.500811 28367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "adfb97e2d44349a692b9fa41cf288fe4"
format_stamp: "Formatted at 2026-08-12 02:43:25 on dist-test-slave-2p8l"
server_key: "db94ca8658b43b78c3047cc43de4777c"
server_key_iv: "646963774d2a56f1865b1f65b44de63c"
server_key_version: "encryptionkey@0"
I20260812 02:43:25.500914 28367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:25.516964 28367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:25.517580 28367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:25.517765 28367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:25.518363 28367 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:43:25.519260 28367 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:43:25.519308 28367 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:25.519347 28367 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:43:25.519399 28367 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:25.528692 28367 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:45359
I20260812 02:43:25.528749 28592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:45359 every 8 connection(s)
I20260812 02:43:25.529596 28367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:43:25.535364 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 28367
I20260812 02:43:25.535511 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:43:25.535845 10541 external_mini_cluster.cc:1428] Setting key f1bee0ac729e1152e92e56ee17ce5d56
I20260812 02:43:25.539858 27854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:25.531571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:46793 (local address 127.10.75.126:36325)
0812 02:43:25.531722 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:25.531725 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:25.532777 (+ 1052us) server_negotiation.cc:407] Connection header received
0812 02:43:25.534258 (+ 1481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:25.534261 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:25.534310 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:25.534383 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:25.535328 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:25.536203 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:25.538006 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:25.538316 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:25.538432 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:25.539432 (+ 1000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:25.539435 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:25.539437 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:43:25.539448 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:25.539465 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:43:25.539473 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:25.539537 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:25.539706 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 02:43:25.539755 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 02:43:25.540750 28602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:25.531953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:36325 (local address 127.10.75.67:46793)
0812 02:43:25.532623 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:25.532662 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:25.533882 (+ 1220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:25.534557 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:25.534564 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:25.534655 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:25.535148 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:25.535162 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:25.536354 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:25.536358 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:25.537868 (+ 1510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:25.537879 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:25.538491 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:25.538494 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:25.538641 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:25.539197 (+ 556us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:43:25.539199 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:25.539237 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:43:25.539298 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:43:25.539549 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:43:25.539556 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:43:25.539560 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 02:43:25.539695 (+ 135us) client_negotiation.cc:240] Negotiation successful
0812 02:43:25.539904 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":130,"threads_started":1}
I20260812 02:43:25.541844 28596 heartbeater.cc:347] Connected to a master server at 127.10.75.126:36325
I20260812 02:43:25.542047 28596 heartbeater.cc:464] Registering TS with master...
I20260812 02:43:25.542541 28596 heartbeater.cc:511] Master 127.10.75.126:36325 requested a full tablet report, sending...
I20260812 02:43:25.543483 27794 ts_manager.cc:194] Registered new tserver with Master: adfb97e2d44349a692b9fa41cf288fe4 (127.10.75.67:45359)
I20260812 02:43:25.544093 27794 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.75.67:46793
I20260812 02:43:25.549706 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 02:43:25.553011 27854 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:25.552007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37242 (local address 127.10.75.126:36325)
0812 02:43:25.552251 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:25.552257 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:25.552400 (+ 143us) server_negotiation.cc:407] Connection header received
0812 02:43:25.552502 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:25.552504 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:25.552542 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:25.552605 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:25.552911 (+ 306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37242: BlockingRecv error: recv got EOF from 127.0.0.1:37242 (error 108)
Metrics: {"server-negotiator.queue_time_us":167}
I20260812 02:43:25.553201 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 27889
I20260812 02:43:25.572014 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 28125
I20260812 02:43:25.588430 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 28367
I20260812 02:43:25.604401 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 27738
2026-08-12T02:43:25Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (1060 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T02:43:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:43:25Z Disabled control of system clock
I20260812 02:43:25.643953 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:43835
--webserver_interface=127.10.75.126
--webserver_port=0
--builtin_ntp_servers=127.10.75.84:38345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:43835
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 02:43:25.758312 28624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:25.758622 28624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:25.758694 28624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:25.762696 28624 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:43:25.762787 28624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:25.762816 28624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:25.762856 28624 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:43:25.762887 28624 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:43:25.767601 28624 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:38345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:43835
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:43835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:25.768667 28624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:25.770025 28624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:25.778900 28646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:25.778919 28640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:25.778975 28624 server_base.cc:1034] running on GCE node
W20260812 02:43:25.778906 28635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:25.779656 28624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:25.780774 28624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:25.781956 28624 hybrid_clock.cc:648] HybridClock initialized: now 1786502605781928 us; error 39 us; skew 500 ppm
I20260812 02:43:25.783849 28624 webserver.cc:460] Webserver started at http://127.10.75.126:36719/ using document root <none> and password file <none>
I20260812 02:43:25.784380 28624 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:25.784441 28624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:25.784670 28624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:25.786770 28624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "35fcf438c07a46968f309e266b9c176b"
format_stamp: "Formatted at 2026-08-12 02:43:25 on dist-test-slave-2p8l"
server_key: "6facf2cfe534cd24ca8f0218d557af14"
server_key_iv: "b4533d924fa772065a5e5cb820d862df"
server_key_version: "encryptionkey@0"
I20260812 02:43:25.787518 28624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "35fcf438c07a46968f309e266b9c176b"
format_stamp: "Formatted at 2026-08-12 02:43:25 on dist-test-slave-2p8l"
server_key: "6facf2cfe534cd24ca8f0218d557af14"
server_key_iv: "b4533d924fa772065a5e5cb820d862df"
server_key_version: "encryptionkey@0"
I20260812 02:43:25.791675 28624 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 02:43:25.794289 28657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:25.795547 28624 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 02:43:25.795677 28624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "35fcf438c07a46968f309e266b9c176b"
format_stamp: "Formatted at 2026-08-12 02:43:25 on dist-test-slave-2p8l"
server_key: "6facf2cfe534cd24ca8f0218d557af14"
server_key_iv: "b4533d924fa772065a5e5cb820d862df"
server_key_version: "encryptionkey@0"
I20260812 02:43:25.795766 28624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:25.800482 28624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:25.801095 28624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:25.801236 28624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:25.808634 28624 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:43835
I20260812 02:43:25.808655 28761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:43835 every 8 connection(s)
I20260812 02:43:25.809643 28624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:43:25.813148 28763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:25.818934 28763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b: Bootstrap starting.
I20260812 02:43:25.819885 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 28624
I20260812 02:43:25.819989 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:43:25.820335 10541 external_mini_cluster.cc:1428] Setting key 4586d8e5cf1ee70ee0a52832ff7d853e
I20260812 02:43:25.822012 28763 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:25.822980 28763 log.cc:824] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b: Log is configured to *not* fsync() on all Append() calls
I20260812 02:43:25.825495 28763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b: No bootstrap required, opened a new log
I20260812 02:43:25.826546 28767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:25.821586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35558 (local address 127.10.75.126:43835)
0812 02:43:25.822410 (+ 824us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:25.822430 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:25.822475 (+ 45us) server_negotiation.cc:407] Connection header received
0812 02:43:25.823380 (+ 905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:25.823406 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:25.823719 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:25.824095 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:25.824890 (+ 795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:25.824896 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:25.824912 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:43:25.824924 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:25.824996 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:43:25.825019 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:25.825144 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:25.825327 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 02:43:25.825579 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":162,"threads_started":1}
I20260812 02:43:25.829939 28763 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35fcf438c07a46968f309e266b9c176b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43835 } }
I20260812 02:43:25.830235 28763 raft_consensus.cc:374] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:25.830286 28763 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35fcf438c07a46968f309e266b9c176b, State: Initialized, Role: FOLLOWER
I20260812 02:43:25.830714 28763 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35fcf438c07a46968f309e266b9c176b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43835 } }
I20260812 02:43:25.830840 28763 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:43:25.830883 28763 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:43:25.830955 28763 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:25.832032 28763 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35fcf438c07a46968f309e266b9c176b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43835 } }
I20260812 02:43:25.832342 28763 leader_election.cc:302] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35fcf438c07a46968f309e266b9c176b; no voters:
I20260812 02:43:25.832615 28763 leader_election.cc:288] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:43:25.832756 28770 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:43:25.832998 28770 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b [term 1 LEADER]: Becoming Leader. State: Replica: 35fcf438c07a46968f309e266b9c176b, State: Running, Role: LEADER
I20260812 02:43:25.833353 28770 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35fcf438c07a46968f309e266b9c176b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43835 } }
I20260812 02:43:25.833897 28763 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:43:25.835076 28774 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35fcf438c07a46968f309e266b9c176b. Latest consensus state: current_term: 1 leader_uuid: "35fcf438c07a46968f309e266b9c176b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35fcf438c07a46968f309e266b9c176b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43835 } } }
I20260812 02:43:25.835212 28774 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b [sys.catalog]: This master's current role is: LEADER
I20260812 02:43:25.835529 28771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "35fcf438c07a46968f309e266b9c176b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35fcf438c07a46968f309e266b9c176b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43835 } } }
I20260812 02:43:25.835634 28771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b [sys.catalog]: This master's current role is: LEADER
I20260812 02:43:25.835744 28784 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:43:25.839210 28784 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:43:25.844643 28784 catalog_manager.cc:1347] Generated new cluster ID: 0b7aeeaa6e7c44a09d66e9581ab3dc79
I20260812 02:43:25.844708 28784 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:43:25.856667 28784 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:43:25.856979 28784 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:43:25.869241 28784 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 35fcf438c07a46968f309e266b9c176b: Generated new TSK 0
I20260812 02:43:25.870031 28784 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:43:25.879544 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43835
--builtin_ntp_servers=127.10.75.84:38345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 02:43:25.994625 28805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:25.994859 28805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:25.994897 28805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:25.999076 28805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:25.999156 28805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:25.999233 28805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:43:26.004074 28805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:38345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:26.005210 28805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:26.006726 28805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:26.016341 28823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:26.016340 28817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:26.016373 28805 server_base.cc:1034] running on GCE node
W20260812 02:43:26.016677 28819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:26.017076 28805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:26.017697 28805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:26.018862 28805 hybrid_clock.cc:648] HybridClock initialized: now 1786502606018811 us; error 64 us; skew 500 ppm
I20260812 02:43:26.020641 28805 webserver.cc:460] Webserver started at http://127.10.75.65:46289/ using document root <none> and password file <none>
I20260812 02:43:26.021184 28805 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:26.021246 28805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:26.021411 28805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:26.023478 28805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "936728a0df3b4ac1b46bf17ff57a7d5d"
format_stamp: "Formatted at 2026-08-12 02:43:26 on dist-test-slave-2p8l"
server_key: "f53b6757d839ea1624b6eeb71661e414"
server_key_iv: "777b365ba0b182be949a679afe3106d8"
server_key_version: "encryptionkey@0"
I20260812 02:43:26.023991 28805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "936728a0df3b4ac1b46bf17ff57a7d5d"
format_stamp: "Formatted at 2026-08-12 02:43:26 on dist-test-slave-2p8l"
server_key: "f53b6757d839ea1624b6eeb71661e414"
server_key_iv: "777b365ba0b182be949a679afe3106d8"
server_key_version: "encryptionkey@0"
I20260812 02:43:26.027765 28805 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 02:43:26.030550 28834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:26.032059 28805 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:43:26.032184 28805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "936728a0df3b4ac1b46bf17ff57a7d5d"
format_stamp: "Formatted at 2026-08-12 02:43:26 on dist-test-slave-2p8l"
server_key: "f53b6757d839ea1624b6eeb71661e414"
server_key_iv: "777b365ba0b182be949a679afe3106d8"
server_key_version: "encryptionkey@0"
I20260812 02:43:26.032312 28805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:26.037477 28805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:26.038123 28805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:26.038282 28805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:26.038926 28805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:43:26.039850 28805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:43:26.039901 28805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:26.039942 28805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:43:26.039958 28805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:26.049441 28805 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:36451
I20260812 02:43:26.049547 29056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:36451 every 8 connection(s)
I20260812 02:43:26.050300 28805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:43:26.056988 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 28805
I20260812 02:43:26.057142 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:43:26.057160 28767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:26.052168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:55605 (local address 127.10.75.126:43835)
0812 02:43:26.052329 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:26.052333 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:26.053377 (+ 1044us) server_negotiation.cc:407] Connection header received
0812 02:43:26.054963 (+ 1586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:26.054966 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:26.055029 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:26.055155 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:26.056462 (+ 1307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:26.056466 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:26.056470 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:43:26.056485 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:26.056604 (+ 119us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:43:26.056634 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:26.056806 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:26.056958 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 02:43:26.057017 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 02:43:26.057492 10541 external_mini_cluster.cc:1428] Setting key df114d7df213c03c0e9cc49d3c4bce3e
I20260812 02:43:26.058154 29063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:26.052464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:43835 (local address 127.10.75.65:55605)
0812 02:43:26.053211 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:26.053253 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:26.054729 (+ 1476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:26.055335 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:26.055342 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:26.055432 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:26.056169 (+ 737us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:43:26.056171 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:26.056214 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:43:26.056293 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:43:26.056790 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:43:26.056801 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:43:26.056808 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 02:43:26.057002 (+ 194us) client_negotiation.cc:240] Negotiation successful
0812 02:43:26.057247 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":156,"threads_started":1}
I20260812 02:43:26.059489 29059 heartbeater.cc:347] Connected to a master server at 127.10.75.126:43835
I20260812 02:43:26.059734 29059 heartbeater.cc:464] Registering TS with master...
I20260812 02:43:26.059799 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43835
--builtin_ntp_servers=127.10.75.84:38345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 02:43:26.060231 29059 heartbeater.cc:511] Master 127.10.75.126:43835 requested a full tablet report, sending...
I20260812 02:43:26.061992 28693 ts_manager.cc:194] Registered new tserver with Master: 936728a0df3b4ac1b46bf17ff57a7d5d (127.10.75.65:36451)
W20260812 02:43:26.175370 29064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:26.175619 29064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:26.175661 29064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:26.179762 29064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:26.179811 29064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:26.179903 29064 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:43:26.184598 29064 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:38345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:26.185590 29064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:26.186939 29064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:26.196583 29073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:26.196566 29074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:26.196843 29064 server_base.cc:1034] running on GCE node
W20260812 02:43:26.196571 29076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:26.197358 29064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:26.198027 29064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:26.199275 29064 hybrid_clock.cc:648] HybridClock initialized: now 1786502606199231 us; error 51 us; skew 500 ppm
I20260812 02:43:26.201251 29064 webserver.cc:460] Webserver started at http://127.10.75.66:35873/ using document root <none> and password file <none>
I20260812 02:43:26.201828 29064 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:26.201925 29064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:26.202226 29064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:26.204289 29064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "483a73a2713a4d669788f479a429933e"
format_stamp: "Formatted at 2026-08-12 02:43:26 on dist-test-slave-2p8l"
server_key: "408ac20cf464bda1bd48774756f57121"
server_key_iv: "a26b0bc99d6fcb98248ba0ac86494c22"
server_key_version: "encryptionkey@0"
I20260812 02:43:26.204878 29064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "483a73a2713a4d669788f479a429933e"
format_stamp: "Formatted at 2026-08-12 02:43:26 on dist-test-slave-2p8l"
server_key: "408ac20cf464bda1bd48774756f57121"
server_key_iv: "a26b0bc99d6fcb98248ba0ac86494c22"
server_key_version: "encryptionkey@0"
I20260812 02:43:26.208629 29064 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260812 02:43:26.211151 29091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:26.212565 29064 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:43:26.212715 29064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "483a73a2713a4d669788f479a429933e"
format_stamp: "Formatted at 2026-08-12 02:43:26 on dist-test-slave-2p8l"
server_key: "408ac20cf464bda1bd48774756f57121"
server_key_iv: "a26b0bc99d6fcb98248ba0ac86494c22"
server_key_version: "encryptionkey@0"
I20260812 02:43:26.212846 29064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:26.217959 29064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:26.218645 29064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:26.218797 29064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:26.219349 29064 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:43:26.220283 29064 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:43:26.220336 29064 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:26.220378 29064 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:43:26.220402 29064 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:26.229763 29064 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:40397
I20260812 02:43:26.229789 29300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:40397 every 8 connection(s)
I20260812 02:43:26.230754 29064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:43:26.237282 28767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:26.232686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:45533 (local address 127.10.75.126:43835)
0812 02:43:26.232880 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:26.232884 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:26.233966 (+ 1082us) server_negotiation.cc:407] Connection header received
0812 02:43:26.235473 (+ 1507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:26.235477 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:26.235525 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:26.235622 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:26.236818 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:26.236822 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:26.236823 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:43:26.236835 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:26.236852 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:43:26.236861 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:26.236938 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:26.237093 (+ 155us) server_negotiation.cc:299] Negotiation successful
0812 02:43:26.237143 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260812 02:43:26.238022 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 29064
I20260812 02:43:26.238169 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:43:26.238266 29306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:26.233090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:43835 (local address 127.10.75.66:45533)
0812 02:43:26.233801 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:26.233863 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:26.235260 (+ 1397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:26.235852 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:26.235859 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:26.235944 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:26.236547 (+ 603us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:43:26.236548 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:26.236587 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:43:26.236653 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:43:26.236940 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:43:26.236947 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:43:26.236952 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 02:43:26.237130 (+ 178us) client_negotiation.cc:240] Negotiation successful
0812 02:43:26.237356 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":122,"threads_started":1}
I20260812 02:43:26.238497 10541 external_mini_cluster.cc:1428] Setting key 6aa0e826de4e978b97625d6d7cdf5b0b
I20260812 02:43:26.239528 29301 heartbeater.cc:347] Connected to a master server at 127.10.75.126:43835
I20260812 02:43:26.239750 29301 heartbeater.cc:464] Registering TS with master...
I20260812 02:43:26.240159 29301 heartbeater.cc:511] Master 127.10.75.126:43835 requested a full tablet report, sending...
I20260812 02:43:26.240702 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43835
--builtin_ntp_servers=127.10.75.84:38345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 02:43:26.241209 28693 ts_manager.cc:194] Registered new tserver with Master: 483a73a2713a4d669788f479a429933e (127.10.75.66:40397)
W20260812 02:43:26.351672 29307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:26.351941 29307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:26.352018 29307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:26.356038 29307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:26.356112 29307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:26.356208 29307 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:43:26.360879 29307 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:38345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:26.361902 29307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:26.363282 29307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:26.372644 29315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:26.372630 29313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:26.372630 29322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:26.372905 29307 server_base.cc:1034] running on GCE node
I20260812 02:43:26.373363 29307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:26.374023 29307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:26.375267 29307 hybrid_clock.cc:648] HybridClock initialized: now 1786502606375255 us; error 26 us; skew 500 ppm
I20260812 02:43:26.377137 29307 webserver.cc:460] Webserver started at http://127.10.75.67:44185/ using document root <none> and password file <none>
I20260812 02:43:26.377640 29307 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:26.377698 29307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:26.377852 29307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:26.379810 29307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "00d2f108becc491391c0f1e6523cd475"
format_stamp: "Formatted at 2026-08-12 02:43:26 on dist-test-slave-2p8l"
server_key: "b64ac9a4a8c833d099413ea3c2c477ae"
server_key_iv: "b551944407ff6dfece6caa29cf645ecd"
server_key_version: "encryptionkey@0"
I20260812 02:43:26.380319 29307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "00d2f108becc491391c0f1e6523cd475"
format_stamp: "Formatted at 2026-08-12 02:43:26 on dist-test-slave-2p8l"
server_key: "b64ac9a4a8c833d099413ea3c2c477ae"
server_key_iv: "b551944407ff6dfece6caa29cf645ecd"
server_key_version: "encryptionkey@0"
I20260812 02:43:26.383818 29307 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 02:43:26.386268 29334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:26.387414 29307 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 02:43:26.387504 29307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "00d2f108becc491391c0f1e6523cd475"
format_stamp: "Formatted at 2026-08-12 02:43:26 on dist-test-slave-2p8l"
server_key: "b64ac9a4a8c833d099413ea3c2c477ae"
server_key_iv: "b551944407ff6dfece6caa29cf645ecd"
server_key_version: "encryptionkey@0"
I20260812 02:43:26.387589 29307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:26.391820 29307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:26.392477 29307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:26.392647 29307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:26.393200 29307 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:43:26.393986 29307 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:43:26.394042 29307 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:26.394172 29307 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:43:26.394192 29307 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:26.403378 29307 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:37349
I20260812 02:43:26.403404 29556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:37349 every 8 connection(s)
I20260812 02:43:26.404211 29307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:43:26.407442 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 29307
I20260812 02:43:26.407609 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:43:26.407876 10541 external_mini_cluster.cc:1428] Setting key 9c60e38e82e219fab36b1489e8ee5d84
I20260812 02:43:26.410504 28767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:26.406047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:46511 (local address 127.10.75.126:43835)
0812 02:43:26.406228 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:26.406231 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:26.407215 (+ 984us) server_negotiation.cc:407] Connection header received
0812 02:43:26.408756 (+ 1541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:26.408760 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:26.408813 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:26.408878 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:26.410164 (+ 1286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:26.410167 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:26.410169 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:43:26.410180 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:26.410199 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:43:26.410207 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:26.410271 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:26.410375 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 02:43:26.410407 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260812 02:43:26.411396 29562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:26.406411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:43835 (local address 127.10.75.67:46511)
0812 02:43:26.407050 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:26.407089 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:26.408503 (+ 1414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:26.409078 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:26.409107 (+ 29us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:26.409213 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:26.409846 (+ 633us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:43:26.409848 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:26.409908 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:43:26.409997 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:43:26.410278 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:43:26.410285 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:43:26.410289 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 02:43:26.410412 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 02:43:26.410633 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":114,"threads_started":1}
I20260812 02:43:26.412403 29558 heartbeater.cc:347] Connected to a master server at 127.10.75.126:43835
I20260812 02:43:26.412623 29558 heartbeater.cc:464] Registering TS with master...
I20260812 02:43:26.413002 29558 heartbeater.cc:511] Master 127.10.75.126:43835 requested a full tablet report, sending...
I20260812 02:43:26.413970 28693 ts_manager.cc:194] Registered new tserver with Master: 00d2f108becc491391c0f1e6523cd475 (127.10.75.67:37349)
I20260812 02:43:26.421756 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 02:43:26.424675 28767 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:43:26.423826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53056 (local address 127.10.75.126:43835)
0812 02:43:26.423948 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:26.423952 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:26.424146 (+ 194us) server_negotiation.cc:407] Connection header received
0812 02:43:26.424211 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:26.424213 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:26.424245 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:26.424313 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:26.424523 (+ 210us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53056: BlockingRecv error: recv got EOF from 127.0.0.1:53056 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 02:43:26.424927 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 28805
I20260812 02:43:26.456470 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 29064
I20260812 02:43:26.471868 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 29307
I20260812 02:43:26.494719 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 28624
2026-08-12T02:43:26Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (886 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:43:26 dist-test-slave-2p8l krb5kdc[29574](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:43:26 dist-test-slave-2p8l krb5kdc[29574](info): set up 2 sockets
Aug 12 02:43:26 dist-test-slave-2p8l krb5kdc[29574](info): commencing operation
krb5kdc: starting...
W20260812 02:43:27.810856 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.290s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:43:27 dist-test-slave-2p8l krb5kdc[29574](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:43:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:43:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:43:27.943178 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:43311
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:33791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:43311
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:43:28.058955 29600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:28.059252 29600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:28.059329 29600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:28.063290 29600 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:43:28.063340 29600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:28.063360 29600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:28.063377 29600 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:43:28.063392 29600 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:43:28.068501 29600 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:33791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:43311
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:43311
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:28.069512 29600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:28.070565 29600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:28.078886 29610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:28.078877 29612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:28.078877 29608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:28.079082 29600 server_base.cc:1034] running on GCE node
I20260812 02:43:28.079690 29600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:28.080717 29600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:28.081881 29600 hybrid_clock.cc:648] HybridClock initialized: now 1786502608081860 us; error 32 us; skew 500 ppm
Aug 12 02:43:28 dist-test-slave-2p8l krb5kdc[29574](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502608, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:43:28.084636 29600 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:43:28.085466 29600 webserver.cc:460] Webserver started at http://127.10.75.126:36313/ using document root <none> and password file <none>
I20260812 02:43:28.085959 29600 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:28.086024 29600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:28.086254 29600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:28.088181 29600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "1a0b73535b8b4698bb5d551f0aeb39f8"
format_stamp: "Formatted at 2026-08-12 02:43:28 on dist-test-slave-2p8l"
server_key: "fc37fdd39d9602e0abbe486525427205"
server_key_iv: "801b88f008eb7d6c8019836443a0ce34"
server_key_version: "encryptionkey@0"
I20260812 02:43:28.088680 29600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "1a0b73535b8b4698bb5d551f0aeb39f8"
format_stamp: "Formatted at 2026-08-12 02:43:28 on dist-test-slave-2p8l"
server_key: "fc37fdd39d9602e0abbe486525427205"
server_key_iv: "801b88f008eb7d6c8019836443a0ce34"
server_key_version: "encryptionkey@0"
I20260812 02:43:28.092245 29600 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260812 02:43:28.094575 29626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:28.095788 29600 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:43:28.095916 29600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "1a0b73535b8b4698bb5d551f0aeb39f8"
format_stamp: "Formatted at 2026-08-12 02:43:28 on dist-test-slave-2p8l"
server_key: "fc37fdd39d9602e0abbe486525427205"
server_key_iv: "801b88f008eb7d6c8019836443a0ce34"
server_key_version: "encryptionkey@0"
I20260812 02:43:28.096015 29600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:28.112613 29600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:28.116024 29600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:28.116245 29600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:28.123623 29600 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:43311
I20260812 02:43:28.123916 29724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:43311 every 8 connection(s)
I20260812 02:43:28.124725 29600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:43:28.127408 29725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:28.130517 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 29600
I20260812 02:43:28.130656 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:43:28.130967 10541 external_mini_cluster.cc:1428] Setting key d61dd7f9b7bc28ca8194624f0f68582f
I20260812 02:43:28.133616 29725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8: Bootstrap starting.
I20260812 02:43:28.135775 29725 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:28.136511 29725 log.cc:824] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8: Log is configured to *not* fsync() on all Append() calls
I20260812 02:43:28.138441 29725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8: No bootstrap required, opened a new log
Aug 12 02:43:28 dist-test-slave-2p8l krb5kdc[29574](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:43:28.141749 29725 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a0b73535b8b4698bb5d551f0aeb39f8" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43311 } }
I20260812 02:43:28.141954 29725 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:28.141987 29725 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a0b73535b8b4698bb5d551f0aeb39f8, State: Initialized, Role: FOLLOWER
I20260812 02:43:28.142481 29725 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a0b73535b8b4698bb5d551f0aeb39f8" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43311 } }
I20260812 02:43:28.142643 29725 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:43:28.142738 29725 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:43:28.142861 29725 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:28.143868 29725 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a0b73535b8b4698bb5d551f0aeb39f8" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43311 } }
I20260812 02:43:28.144210 29725 leader_election.cc:302] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a0b73535b8b4698bb5d551f0aeb39f8; no voters:
I20260812 02:43:28.144518 29725 leader_election.cc:288] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:43:28.144630 29737 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:43:28.144868 29737 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8 [term 1 LEADER]: Becoming Leader. State: Replica: 1a0b73535b8b4698bb5d551f0aeb39f8, State: Running, Role: LEADER
I20260812 02:43:28.145193 29737 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a0b73535b8b4698bb5d551f0aeb39f8" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43311 } }
I20260812 02:43:28.145817 29725 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:43:28.146430 29739 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a0b73535b8b4698bb5d551f0aeb39f8. Latest consensus state: current_term: 1 leader_uuid: "1a0b73535b8b4698bb5d551f0aeb39f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a0b73535b8b4698bb5d551f0aeb39f8" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43311 } } }
I20260812 02:43:28.146683 29739 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8 [sys.catalog]: This master's current role is: LEADER
I20260812 02:43:28.146862 29738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a0b73535b8b4698bb5d551f0aeb39f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a0b73535b8b4698bb5d551f0aeb39f8" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43311 } } }
I20260812 02:43:28.146966 29738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8 [sys.catalog]: This master's current role is: LEADER
I20260812 02:43:28.147276 29731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:28.132404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60508 (local address 127.10.75.126:43311)
0812 02:43:28.132854 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:28.132869 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:28.132904 (+ 35us) server_negotiation.cc:407] Connection header received
0812 02:43:28.133611 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:28.133628 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:28.133986 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:28.134375 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:28.135183 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.136253 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.137166 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.137615 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.137782 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:28.140535 (+ 2753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:28.140542 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:28.140564 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:28.140593 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:28.143290 (+ 2697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:28.143807 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:28.143812 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:28.143816 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:28.143928 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:28.144247 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:28.144251 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:28.144253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:28.144900 (+ 647us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:28.145719 (+ 819us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:28.145883 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 02:43:28.146209 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":149,"threads_started":1}
W20260812 02:43:28.150693 29756 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:43:28.150774 29756 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:43:28.150833 29748 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:43:28.151733 29748 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:43:28.164901 29748 catalog_manager.cc:1347] Generated new cluster ID: 1212baf4b1804609b1cd936bd3815150
I20260812 02:43:28.164986 29748 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:43:28.191816 29748 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:43:28.192775 29748 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:43:28.214449 29748 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8: Generated new TSK 0
I20260812 02:43:28.215191 29748 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
I20260812 02:43:28.252884 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43311
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:33791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:43:28.366429 29767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:28.366683 29767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:28.366725 29767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:28.370769 29767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:28.370826 29767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:28.370910 29767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:43:28.376106 29767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:33791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43311
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:28.377131 29767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:28.378193 29767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:28.387930 29774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:28.387888 29776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:28.387882 29773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:28.388054 29767 server_base.cc:1034] running on GCE node
I20260812 02:43:28.388691 29767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:28.389369 29767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:28.390563 29767 hybrid_clock.cc:648] HybridClock initialized: now 1786502608390548 us; error 25 us; skew 500 ppm
Aug 12 02:43:28 dist-test-slave-2p8l krb5kdc[29574](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502608, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:43:28.393446 29767 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:43:28.394381 29767 webserver.cc:460] Webserver started at http://127.10.75.65:34013/ using document root <none> and password file <none>
I20260812 02:43:28.394940 29767 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:28.395037 29767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:28.395275 29767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:28.397321 29767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "f9bc1a3725f54e08a3f01b83119b49a0"
format_stamp: "Formatted at 2026-08-12 02:43:28 on dist-test-slave-2p8l"
server_key: "8d68ccd4baef662eaae3efb8fd54d38a"
server_key_iv: "f99bc98008eb6c2f075ff0bad8d8b327"
server_key_version: "encryptionkey@0"
I20260812 02:43:28.397895 29767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "f9bc1a3725f54e08a3f01b83119b49a0"
format_stamp: "Formatted at 2026-08-12 02:43:28 on dist-test-slave-2p8l"
server_key: "8d68ccd4baef662eaae3efb8fd54d38a"
server_key_iv: "f99bc98008eb6c2f075ff0bad8d8b327"
server_key_version: "encryptionkey@0"
I20260812 02:43:28.401819 29767 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260812 02:43:28.404425 29793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:28.405725 29767 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:43:28.405890 29767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "f9bc1a3725f54e08a3f01b83119b49a0"
format_stamp: "Formatted at 2026-08-12 02:43:28 on dist-test-slave-2p8l"
server_key: "8d68ccd4baef662eaae3efb8fd54d38a"
server_key_iv: "f99bc98008eb6c2f075ff0bad8d8b327"
server_key_version: "encryptionkey@0"
I20260812 02:43:28.406009 29767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:28.432675 29767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:28.435974 29767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:28.436189 29767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:28.436815 29767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:43:28.437664 29767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:43:28.437738 29767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:28.437819 29767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:43:28.437865 29767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:28.447268 29767 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:38447
I20260812 02:43:28.447335 30011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:38447 every 8 connection(s)
I20260812 02:43:28.448251 29767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:43:28.449864 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 29767
I20260812 02:43:28.450022 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:43:28.450357 10541 external_mini_cluster.cc:1428] Setting key a742e6fe90c54c0480c9c592d77ef9a0
Aug 12 02:43:28 dist-test-slave-2p8l krb5kdc[29574](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502608, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.75.66@KRBTEST.COM; defaulting to no policy
I20260812 02:43:28.462775 29731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:28.450152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:41611 (local address 127.10.75.126:43311)
0812 02:43:28.450302 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:28.450307 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:28.451259 (+ 952us) server_negotiation.cc:407] Connection header received
0812 02:43:28.452681 (+ 1422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:28.452685 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:28.452737 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:28.452819 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:28.453952 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.454569 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.455704 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.455946 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.456060 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:28.458899 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:28.458904 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:28.458907 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:28.458937 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:28.460674 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:28.461236 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:28.461241 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:28.461245 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:28.461343 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:28.461683 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:28.461686 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:28.461687 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:28.461866 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:28.461947 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:28.462539 (+ 592us) server_negotiation.cc:299] Negotiation successful
0812 02:43:28.462648 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 02:43:28.463678 30016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:28.450628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:43311 (local address 127.10.75.65:41611)
0812 02:43:28.451104 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:28.451156 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:28.452465 (+ 1309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:28.452992 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:28.452998 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:28.453346 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:28.453797 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:28.453810 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.454700 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.454704 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:28.455573 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:28.455583 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.456106 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.456110 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:28.456282 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:28.456956 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:28.456972 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:28.458726 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:43:28.460796 (+ 2070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:28.460801 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:28.460812 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:28.461133 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:28.461457 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:28.461459 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:28.461460 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:28.461592 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:28.461970 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:43:28.461975 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:43:28.462305 (+ 330us) client_negotiation.cc:769] Sending connection context
0812 02:43:28.462478 (+ 173us) client_negotiation.cc:240] Negotiation successful
0812 02:43:28.462734 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":136,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.66@KRBTEST.COM" created.
I20260812 02:43:28.465243 30013 heartbeater.cc:347] Connected to a master server at 127.10.75.126:43311
I20260812 02:43:28.465492 30013 heartbeater.cc:464] Registering TS with master...
I20260812 02:43:28.466085 30013 heartbeater.cc:511] Master 127.10.75.126:43311 requested a full tablet report, sending...
I20260812 02:43:28.467700 29654 ts_manager.cc:194] Registered new tserver with Master: f9bc1a3725f54e08a3f01b83119b49a0 (127.10.75.65:38447)
I20260812 02:43:28.468890 29654 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:41611
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
I20260812 02:43:28.480746 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43311
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:33791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:43:28.591513 30024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:28.591787 30024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:28.591863 30024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:28.595769 30024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:28.595849 30024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:28.595937 30024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:43:28.601186 30024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:33791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43311
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:28.602210 30024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:28.603216 30024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:28.612903 30032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:28.612926 30035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:28.613116 30024 server_base.cc:1034] running on GCE node
W20260812 02:43:28.612910 30031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:28.613749 30024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:28.614416 30024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:28.615593 30024 hybrid_clock.cc:648] HybridClock initialized: now 1786502608615582 us; error 27 us; skew 500 ppm
Aug 12 02:43:28 dist-test-slave-2p8l krb5kdc[29574](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502608, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:43:28.618345 30024 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:43:28.619279 30024 webserver.cc:460] Webserver started at http://127.10.75.66:42401/ using document root <none> and password file <none>
I20260812 02:43:28.619840 30024 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:28.619936 30024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:28.620180 30024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:28.622336 30024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "b3eb1a81f6d4409887715b39decd4c65"
format_stamp: "Formatted at 2026-08-12 02:43:28 on dist-test-slave-2p8l"
server_key: "f66daf8ca9a2677a610bcf7fb24ecbbb"
server_key_iv: "5a0acae74278d688e39c254264e087a9"
server_key_version: "encryptionkey@0"
I20260812 02:43:28.622908 30024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "b3eb1a81f6d4409887715b39decd4c65"
format_stamp: "Formatted at 2026-08-12 02:43:28 on dist-test-slave-2p8l"
server_key: "f66daf8ca9a2677a610bcf7fb24ecbbb"
server_key_iv: "5a0acae74278d688e39c254264e087a9"
server_key_version: "encryptionkey@0"
I20260812 02:43:28.626648 30024 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:43:28.629084 30052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:28.630437 30024 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:43:28.630642 30024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "b3eb1a81f6d4409887715b39decd4c65"
format_stamp: "Formatted at 2026-08-12 02:43:28 on dist-test-slave-2p8l"
server_key: "f66daf8ca9a2677a610bcf7fb24ecbbb"
server_key_iv: "5a0acae74278d688e39c254264e087a9"
server_key_version: "encryptionkey@0"
I20260812 02:43:28.630757 30024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:28.647714 30024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:28.650871 30024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:28.651072 30024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:28.651662 30024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:43:28.652486 30024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:43:28.652565 30024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:28.652637 30024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:43:28.652688 30024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:28.661715 30024 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:41977
I20260812 02:43:28.661744 30254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:41977 every 8 connection(s)
I20260812 02:43:28.662650 30024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:43:28.667896 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 30024
I20260812 02:43:28.667994 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:43:28.668292 10541 external_mini_cluster.cc:1428] Setting key dc4785a683884d504b21e5559864e191
Aug 12 02:43:28 dist-test-slave-2p8l krb5kdc[29574](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502608, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:43:28.677614 29731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:28.664517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:53697 (local address 127.10.75.126:43311)
0812 02:43:28.664684 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:28.664689 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:28.665691 (+ 1002us) server_negotiation.cc:407] Connection header received
0812 02:43:28.667097 (+ 1406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:28.667100 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:28.667147 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:28.667229 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:28.668528 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.669171 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.670479 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.670705 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.670822 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:28.673384 (+ 2562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:28.673391 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:28.673397 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:28.673433 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:28.675283 (+ 1850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:28.675919 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:28.675926 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:28.675929 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:28.676034 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:28.676394 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:28.676400 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:28.676405 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:28.676676 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:28.676798 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:28.677281 (+ 483us) server_negotiation.cc:299] Negotiation successful
0812 02:43:28.677418 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 02:43:28.678464 30258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:28.664994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:43311 (local address 127.10.75.66:53697)
0812 02:43:28.665499 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:28.665541 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:28.666859 (+ 1318us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:28.667387 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:28.667393 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:28.667785 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:28.668354 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:28.668376 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.669303 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.669306 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:28.670351 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:28.670361 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.670861 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.670866 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:28.671030 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:28.671717 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:28.671744 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:28.673200 (+ 1456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:43:28.675418 (+ 2218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:28.675423 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:28.675435 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:28.675794 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:28.676154 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:28.676156 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:28.676157 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:28.676289 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:28.676797 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:43:28.676802 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:43:28.677030 (+ 228us) client_negotiation.cc:769] Sending connection context
0812 02:43:28.677191 (+ 161us) client_negotiation.cc:240] Negotiation successful
0812 02:43:28.677444 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":134,"threads_started":1}
WARNING: no policy specified for kudu/127.10.75.67@KRBTEST.COM; defaulting to no policy
I20260812 02:43:28.679768 30255 heartbeater.cc:347] Connected to a master server at 127.10.75.126:43311
I20260812 02:43:28.680018 30255 heartbeater.cc:464] Registering TS with master...
I20260812 02:43:28.680550 30255 heartbeater.cc:511] Master 127.10.75.126:43311 requested a full tablet report, sending...
I20260812 02:43:28.681653 29654 ts_manager.cc:194] Registered new tserver with Master: b3eb1a81f6d4409887715b39decd4c65 (127.10.75.66:41977)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.67@KRBTEST.COM" created.
I20260812 02:43:28.682341 29654 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:53697
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
I20260812 02:43:28.700994 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43311
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:33791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:43:28.815167 30269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:43:28.815411 30269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:43:28.815483 30269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:43:28.819594 30269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:43:28.819645 30269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:43:28.819741 30269 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:43:28.824919 30269 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:33791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43311
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30269
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:43:28.825987 30269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:43:28.827083 30269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:43:28.836957 30284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:28.837041 30269 server_base.cc:1034] running on GCE node
W20260812 02:43:28.836917 30280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:43:28.836917 30279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:43:28.837630 30269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:43:28.838340 30269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:43:28.839519 30269 hybrid_clock.cc:648] HybridClock initialized: now 1786502608839495 us; error 40 us; skew 500 ppm
Aug 12 02:43:28 dist-test-slave-2p8l krb5kdc[29574](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502608, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:43:28.842696 30269 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:43:28.843557 30269 webserver.cc:460] Webserver started at http://127.10.75.67:37371/ using document root <none> and password file <none>
I20260812 02:43:28.844105 30269 fs_manager.cc:359] Metadata directory not provided
I20260812 02:43:28.844170 30269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:43:28.844344 30269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:43:28.846669 30269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "9d0b2c989d5c4f7687a22e68b3301ae4"
format_stamp: "Formatted at 2026-08-12 02:43:28 on dist-test-slave-2p8l"
server_key: "f58ba4885563cb27b1355700930aa635"
server_key_iv: "2cfed6319028505ef69bd0423e6da9c2"
server_key_version: "encryptionkey@0"
I20260812 02:43:28.847482 30269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "9d0b2c989d5c4f7687a22e68b3301ae4"
format_stamp: "Formatted at 2026-08-12 02:43:28 on dist-test-slave-2p8l"
server_key: "f58ba4885563cb27b1355700930aa635"
server_key_iv: "2cfed6319028505ef69bd0423e6da9c2"
server_key_version: "encryptionkey@0"
I20260812 02:43:28.851430 30269 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 02:43:28.853995 30293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:28.855403 30269 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:43:28.855554 30269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "9d0b2c989d5c4f7687a22e68b3301ae4"
format_stamp: "Formatted at 2026-08-12 02:43:28 on dist-test-slave-2p8l"
server_key: "f58ba4885563cb27b1355700930aa635"
server_key_iv: "2cfed6319028505ef69bd0423e6da9c2"
server_key_version: "encryptionkey@0"
I20260812 02:43:28.855654 30269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:43:28.881788 30269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:43:28.885667 30269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:43:28.885914 30269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:43:28.886613 30269 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:43:28.887555 30269 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:43:28.887640 30269 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:28.887713 30269 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:43:28.887771 30269 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:43:28.897749 30269 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:43835
I20260812 02:43:28.897794 30491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:43835 every 8 connection(s)
I20260812 02:43:28.898802 30269 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:43:28.908916 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 30269
I20260812 02:43:28.909075 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:43:28.909373 10541 external_mini_cluster.cc:1428] Setting key dfa18ea27f49e10d9b1f7d2ab9208c1f
Aug 12 02:43:28 dist-test-slave-2p8l krb5kdc[29574](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502608, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:43:28.914713 29731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:28.900984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:38449 (local address 127.10.75.126:43311)
0812 02:43:28.901170 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:28.901176 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:28.902170 (+ 994us) server_negotiation.cc:407] Connection header received
0812 02:43:28.903817 (+ 1647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:28.903820 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:28.903868 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:28.903948 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:28.905233 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.905850 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.907187 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.907417 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.907513 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:28.910644 (+ 3131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:28.910649 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:28.910652 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:28.910688 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:28.912345 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:28.912944 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:28.912948 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:28.912950 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:28.913053 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:28.913442 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:28.913446 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:28.913447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:28.913654 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:28.913775 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:28.914381 (+ 606us) server_negotiation.cc:299] Negotiation successful
0812 02:43:28.914525 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 02:43:28.915544 30498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:28.901453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:43311 (local address 127.10.75.67:38449)
0812 02:43:28.901940 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:28.901986 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:28.903584 (+ 1598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:28.904135 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:28.904141 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:28.904556 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:43:28.905064 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:28.905079 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.906003 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.906006 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:28.907054 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:28.907065 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.907584 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.907588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:28.907746 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:28.908398 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:43:28.908415 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:43:28.910374 (+ 1959us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:43:28.912506 (+ 2132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:28.912513 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:28.912528 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:28.912818 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:28.913161 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:43:28.913166 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:43:28.913168 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:43:28.913325 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:43:28.913774 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:43:28.913782 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:43:28.914041 (+ 259us) client_negotiation.cc:769] Sending connection context
0812 02:43:28.914311 (+ 270us) client_negotiation.cc:240] Negotiation successful
0812 02:43:28.914672 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":127,"threads_started":1}
I20260812 02:43:28.916651 30492 heartbeater.cc:347] Connected to a master server at 127.10.75.126:43311
I20260812 02:43:28.916896 30492 heartbeater.cc:464] Registering TS with master...
I20260812 02:43:28.917438 30492 heartbeater.cc:511] Master 127.10.75.126:43311 requested a full tablet report, sending...
I20260812 02:43:28.918570 29654 ts_manager.cc:194] Registered new tserver with Master: 9d0b2c989d5c4f7687a22e68b3301ae4 (127.10.75.67:43835)
I20260812 02:43:28.919147 29654 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:38449
I20260812 02:43:28.923280 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:43:28.933523 29731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:28.925334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60512 (local address 127.10.75.126:43311)
0812 02:43:28.925466 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:28.925469 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:28.925721 (+ 252us) server_negotiation.cc:407] Connection header received
0812 02:43:28.925878 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:28.925882 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:28.925931 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:28.926011 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:43:28.926748 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.927264 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.928106 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.928336 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.928444 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:28.929946 (+ 1502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:43:28.929950 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:43:28.929952 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:43:28.929980 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:43:28.931666 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:28.932172 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:28.932176 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:28.932177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:28.932270 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:43:28.932573 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:43:28.932577 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:43:28.932579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:43:28.932819 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:43:28.932987 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:28.933238 (+ 251us) server_negotiation.cc:299] Negotiation successful
0812 02:43:28.933363 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 02:43:28.936899 29654 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60512:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:43:28.940100 29654 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:43:28.955103 30515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:28.949105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46028 (local address 127.10.75.65:38447)
0812 02:43:28.949706 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:28.949723 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:28.949746 (+ 23us) server_negotiation.cc:407] Connection header received
0812 02:43:28.949826 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:28.949831 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:28.950046 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:28.950304 (+ 258us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:43:28.950728 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.951853 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.953582 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.954301 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.954440 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:28.954612 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:28.954816 (+ 204us) server_negotiation.cc:299] Negotiation successful
0812 02:43:28.954922 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":100,"threads_started":1}
I20260812 02:43:28.955102 30513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:28.948951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:38447 (local address 127.0.0.1:46028)
0812 02:43:28.949328 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:28.949379 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:28.949517 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:28.950409 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:28.950416 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:28.950442 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:43:28.950578 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:28.950589 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.952003 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.952007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:28.953435 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:28.953446 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.954440 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.954444 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:28.954585 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:28.954630 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 02:43:28.954779 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 02:43:28.954919 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":1,"thread_start_us":112,"threads_started":1}
I20260812 02:43:28.955516 30516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:28.949763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:43835 (local address 127.0.0.1:43516)
0812 02:43:28.950017 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:28.950035 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:28.950161 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:28.951149 (+ 988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:28.951152 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:28.951172 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:43:28.951275 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:28.951281 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.952770 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.952774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:28.953961 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:28.953971 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.955126 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.955130 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:28.955222 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:28.955246 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 02:43:28.955298 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 02:43:28.955386 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":115,"threads_started":1}
I20260812 02:43:28.955886 30522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:28.950691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:41977 (local address 127.0.0.1:37274)
0812 02:43:28.950930 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:28.950947 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:28.951057 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:28.951527 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:28.951530 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:28.951552 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:43:28.951652 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:28.951660 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.953199 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.953202 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:28.954361 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:28.954371 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.955431 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.955435 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:28.955578 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:28.955603 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 02:43:28.955669 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 02:43:28.955737 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":2,"thread_start_us":97,"threads_started":1}
I20260812 02:43:28.956163 30517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:28.950260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43516 (local address 127.10.75.67:43835)
0812 02:43:28.950677 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:28.950692 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:28.950716 (+ 24us) server_negotiation.cc:407] Connection header received
0812 02:43:28.950791 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:28.950796 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:28.950964 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:28.951420 (+ 456us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:43:28.951611 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.952622 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.954145 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.954980 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.955719 (+ 739us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:28.955858 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:28.955907 (+ 49us) server_negotiation.cc:299] Negotiation successful
0812 02:43:28.955994 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":186,"threads_started":1}
I20260812 02:43:28.956537 30519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:28.950464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37274 (local address 127.10.75.66:41977)
0812 02:43:28.951105 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:28.951119 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:28.951144 (+ 25us) server_negotiation.cc:407] Connection header received
0812 02:43:28.951226 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:28.951230 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:28.951368 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:28.951541 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:43:28.951777 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.953038 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.954502 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:28.955301 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:28.955403 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:28.956194 (+ 791us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:28.956255 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 02:43:28.956347 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":516,"thread_start_us":125,"threads_started":1}
I20260812 02:43:28.959781 30148 tablet_service.cc:1467] Processing CreateTablet for tablet 161860a81bda4200a0ab8106ed848430 (DEFAULT_TABLE table=test-table [id=96c28d6da66f4430a8e996fb574b192a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:43:28.959708 29883 tablet_service.cc:1467] Processing CreateTablet for tablet 161860a81bda4200a0ab8106ed848430 (DEFAULT_TABLE table=test-table [id=96c28d6da66f4430a8e996fb574b192a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:43:28.959751 30387 tablet_service.cc:1467] Processing CreateTablet for tablet 161860a81bda4200a0ab8106ed848430 (DEFAULT_TABLE table=test-table [id=96c28d6da66f4430a8e996fb574b192a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:43:28.960916 30148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 161860a81bda4200a0ab8106ed848430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:28.960916 29883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 161860a81bda4200a0ab8106ed848430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:28.961012 30387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 161860a81bda4200a0ab8106ed848430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:43:28.970582 30529 tablet_bootstrap.cc:492] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65: Bootstrap starting.
I20260812 02:43:28.973752 30529 tablet_bootstrap.cc:654] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:28.974306 30523 tablet_bootstrap.cc:492] T 161860a81bda4200a0ab8106ed848430 P f9bc1a3725f54e08a3f01b83119b49a0: Bootstrap starting.
I20260812 02:43:28.974785 30529 log.cc:824] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65: Log is configured to *not* fsync() on all Append() calls
I20260812 02:43:28.974905 30532 tablet_bootstrap.cc:492] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4: Bootstrap starting.
I20260812 02:43:28.976518 30523 tablet_bootstrap.cc:654] T 161860a81bda4200a0ab8106ed848430 P f9bc1a3725f54e08a3f01b83119b49a0: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:28.976775 30529 tablet_bootstrap.cc:492] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65: No bootstrap required, opened a new log
I20260812 02:43:28.976941 30532 tablet_bootstrap.cc:654] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4: Neither blocks nor log segments found. Creating new log.
I20260812 02:43:28.976987 30529 ts_tablet_manager.cc:1397] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260812 02:43:28.977381 30523 log.cc:824] T 161860a81bda4200a0ab8106ed848430 P f9bc1a3725f54e08a3f01b83119b49a0: Log is configured to *not* fsync() on all Append() calls
I20260812 02:43:28.978258 30532 log.cc:824] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4: Log is configured to *not* fsync() on all Append() calls
I20260812 02:43:28.979487 30523 tablet_bootstrap.cc:492] T 161860a81bda4200a0ab8106ed848430 P f9bc1a3725f54e08a3f01b83119b49a0: No bootstrap required, opened a new log
I20260812 02:43:28.979677 30523 ts_tablet_manager.cc:1397] T 161860a81bda4200a0ab8106ed848430 P f9bc1a3725f54e08a3f01b83119b49a0: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260812 02:43:28.980315 30532 tablet_bootstrap.cc:492] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4: No bootstrap required, opened a new log
I20260812 02:43:28.980516 30532 ts_tablet_manager.cc:1397] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 02:43:28.980724 30529 raft_consensus.cc:348] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9bc1a3725f54e08a3f01b83119b49a0" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 38447 } } peers { permanent_uuid: "9d0b2c989d5c4f7687a22e68b3301ae4" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43835 } } peers { permanent_uuid: "b3eb1a81f6d4409887715b39decd4c65" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41977 } }
I20260812 02:43:28.981112 30529 raft_consensus.cc:374] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:28.981189 30529 raft_consensus.cc:729] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3eb1a81f6d4409887715b39decd4c65, State: Initialized, Role: FOLLOWER
I20260812 02:43:28.981671 30529 consensus_queue.cc:260] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9bc1a3725f54e08a3f01b83119b49a0" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 38447 } } peers { permanent_uuid: "9d0b2c989d5c4f7687a22e68b3301ae4" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43835 } } peers { permanent_uuid: "b3eb1a81f6d4409887715b39decd4c65" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41977 } }
I20260812 02:43:28.982370 30255 heartbeater.cc:503] Master 127.10.75.126:43311 was elected leader, sending a full tablet report...
I20260812 02:43:28.982664 30529 ts_tablet_manager.cc:1428] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260812 02:43:28.984305 30532 raft_consensus.cc:348] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9bc1a3725f54e08a3f01b83119b49a0" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 38447 } } peers { permanent_uuid: "9d0b2c989d5c4f7687a22e68b3301ae4" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43835 } } peers { permanent_uuid: "b3eb1a81f6d4409887715b39decd4c65" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41977 } }
I20260812 02:43:28.984612 30532 raft_consensus.cc:374] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:28.984686 30532 raft_consensus.cc:729] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0b2c989d5c4f7687a22e68b3301ae4, State: Initialized, Role: FOLLOWER
I20260812 02:43:28.985126 30532 consensus_queue.cc:260] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9bc1a3725f54e08a3f01b83119b49a0" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 38447 } } peers { permanent_uuid: "9d0b2c989d5c4f7687a22e68b3301ae4" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43835 } } peers { permanent_uuid: "b3eb1a81f6d4409887715b39decd4c65" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41977 } }
I20260812 02:43:28.985189 30523 raft_consensus.cc:348] T 161860a81bda4200a0ab8106ed848430 P f9bc1a3725f54e08a3f01b83119b49a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9bc1a3725f54e08a3f01b83119b49a0" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 38447 } } peers { permanent_uuid: "9d0b2c989d5c4f7687a22e68b3301ae4" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43835 } } peers { permanent_uuid: "b3eb1a81f6d4409887715b39decd4c65" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41977 } }
I20260812 02:43:28.985448 30523 raft_consensus.cc:374] T 161860a81bda4200a0ab8106ed848430 P f9bc1a3725f54e08a3f01b83119b49a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:43:28.985534 30523 raft_consensus.cc:729] T 161860a81bda4200a0ab8106ed848430 P f9bc1a3725f54e08a3f01b83119b49a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9bc1a3725f54e08a3f01b83119b49a0, State: Initialized, Role: FOLLOWER
I20260812 02:43:28.985976 30523 consensus_queue.cc:260] T 161860a81bda4200a0ab8106ed848430 P f9bc1a3725f54e08a3f01b83119b49a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9bc1a3725f54e08a3f01b83119b49a0" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 38447 } } peers { permanent_uuid: "9d0b2c989d5c4f7687a22e68b3301ae4" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43835 } } peers { permanent_uuid: "b3eb1a81f6d4409887715b39decd4c65" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41977 } }
I20260812 02:43:28.986119 30532 ts_tablet_manager.cc:1428] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 02:43:28.986454 30492 heartbeater.cc:503] Master 127.10.75.126:43311 was elected leader, sending a full tablet report...
I20260812 02:43:28.987072 30523 ts_tablet_manager.cc:1428] T 161860a81bda4200a0ab8106ed848430 P f9bc1a3725f54e08a3f01b83119b49a0: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 02:43:28.987442 30013 heartbeater.cc:503] Master 127.10.75.126:43311 was elected leader, sending a full tablet report...
I20260812 02:43:29.057477 30538 raft_consensus.cc:482] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:43:29.057761 30538 raft_consensus.cc:504] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9bc1a3725f54e08a3f01b83119b49a0" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 38447 } } peers { permanent_uuid: "9d0b2c989d5c4f7687a22e68b3301ae4" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43835 } } peers { permanent_uuid: "b3eb1a81f6d4409887715b39decd4c65" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41977 } }
I20260812 02:43:29.059060 30538 leader_election.cc:288] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9bc1a3725f54e08a3f01b83119b49a0 (127.10.75.65:38447), 9d0b2c989d5c4f7687a22e68b3301ae4 (127.10.75.67:43835)
I20260812 02:43:29.064265 30517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:29.060106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:36897 (local address 127.10.75.67:43835)
0812 02:43:29.060252 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:29.060257 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:29.060272 (+ 15us) server_negotiation.cc:407] Connection header received
0812 02:43:29.060324 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:29.060326 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:29.060377 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:29.060461 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:43:29.060694 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:29.061400 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:29.062882 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:29.063483 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:29.063599 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:29.063644 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:29.064052 (+ 408us) server_negotiation.cc:299] Negotiation successful
0812 02:43:29.064138 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 02:43:29.064265 30515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:29.059496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:47617 (local address 127.10.75.65:38447)
0812 02:43:29.059645 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:29.059650 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:29.059667 (+ 17us) server_negotiation.cc:407] Connection header received
0812 02:43:29.059774 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:29.059777 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:29.059821 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:29.059914 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:43:29.060317 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:29.061145 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:29.062780 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:29.063452 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:29.063588 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:29.063644 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:29.064052 (+ 408us) server_negotiation.cc:299] Negotiation successful
0812 02:43:29.064136 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 02:43:29.064260 30258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:29.059387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:38447 (local address 127.10.75.66:47617)
0812 02:43:29.059553 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:29.059570 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:29.059676 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:29.059959 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:29.059962 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:29.059981 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:43:29.060111 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:29.060117 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:29.061289 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:29.061291 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:29.062624 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:29.062636 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:29.063641 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:29.063645 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:29.063866 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:29.063914 (+ 48us) client_negotiation.cc:769] Sending connection context
0812 02:43:29.063998 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 02:43:29.064116 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"mutex_wait_us":65}
I20260812 02:43:29.064270 30544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:29.059674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:43835 (local address 127.10.75.66:36897)
0812 02:43:29.060037 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:29.060052 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:43:29.060156 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:43:29.060471 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:43:29.060473 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:43:29.060486 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:43:29.060588 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:29.060592 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:29.061498 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:29.061502 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:29.062735 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:43:29.062745 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:43:29.063641 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:43:29.063645 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:43:29.063861 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:29.063914 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 02:43:29.063998 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 02:43:29.064097 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":89,"thread_start_us":134,"threads_started":1}
I20260812 02:43:29.065069 29928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "161860a81bda4200a0ab8106ed848430" candidate_uuid: "b3eb1a81f6d4409887715b39decd4c65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9bc1a3725f54e08a3f01b83119b49a0" is_pre_election: true
I20260812 02:43:29.065073 30417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "161860a81bda4200a0ab8106ed848430" candidate_uuid: "b3eb1a81f6d4409887715b39decd4c65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0b2c989d5c4f7687a22e68b3301ae4" is_pre_election: true
I20260812 02:43:29.065393 29928 raft_consensus.cc:2454] T 161860a81bda4200a0ab8106ed848430 P f9bc1a3725f54e08a3f01b83119b49a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3eb1a81f6d4409887715b39decd4c65 in term 0.
I20260812 02:43:29.065398 30417 raft_consensus.cc:2454] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3eb1a81f6d4409887715b39decd4c65 in term 0.
I20260812 02:43:29.065905 30054 leader_election.cc:302] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3eb1a81f6d4409887715b39decd4c65, f9bc1a3725f54e08a3f01b83119b49a0; no voters:
I20260812 02:43:29.066224 30538 raft_consensus.cc:2781] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:43:29.066322 30538 raft_consensus.cc:482] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:43:29.066370 30538 raft_consensus.cc:3037] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:29.067427 30538 raft_consensus.cc:504] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9bc1a3725f54e08a3f01b83119b49a0" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 38447 } } peers { permanent_uuid: "9d0b2c989d5c4f7687a22e68b3301ae4" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43835 } } peers { permanent_uuid: "b3eb1a81f6d4409887715b39decd4c65" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41977 } }
I20260812 02:43:29.067770 30538 leader_election.cc:288] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [CANDIDATE]: Term 1 election: Requested vote from peers f9bc1a3725f54e08a3f01b83119b49a0 (127.10.75.65:38447), 9d0b2c989d5c4f7687a22e68b3301ae4 (127.10.75.67:43835)
I20260812 02:43:29.068212 29928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "161860a81bda4200a0ab8106ed848430" candidate_uuid: "b3eb1a81f6d4409887715b39decd4c65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9bc1a3725f54e08a3f01b83119b49a0"
I20260812 02:43:29.068331 29928 raft_consensus.cc:3037] T 161860a81bda4200a0ab8106ed848430 P f9bc1a3725f54e08a3f01b83119b49a0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:29.069525 29928 raft_consensus.cc:2454] T 161860a81bda4200a0ab8106ed848430 P f9bc1a3725f54e08a3f01b83119b49a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3eb1a81f6d4409887715b39decd4c65 in term 1.
I20260812 02:43:29.069820 30417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "161860a81bda4200a0ab8106ed848430" candidate_uuid: "b3eb1a81f6d4409887715b39decd4c65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0b2c989d5c4f7687a22e68b3301ae4"
I20260812 02:43:29.069855 30054 leader_election.cc:302] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3eb1a81f6d4409887715b39decd4c65, f9bc1a3725f54e08a3f01b83119b49a0; no voters:
I20260812 02:43:29.070005 30417 raft_consensus.cc:3037] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:43:29.070034 30538 raft_consensus.cc:2781] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:43:29.070312 30538 raft_consensus.cc:686] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [term 1 LEADER]: Becoming Leader. State: Replica: b3eb1a81f6d4409887715b39decd4c65, State: Running, Role: LEADER
I20260812 02:43:29.070847 30538 consensus_queue.cc:237] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9bc1a3725f54e08a3f01b83119b49a0" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 38447 } } peers { permanent_uuid: "9d0b2c989d5c4f7687a22e68b3301ae4" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43835 } } peers { permanent_uuid: "b3eb1a81f6d4409887715b39decd4c65" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41977 } }
I20260812 02:43:29.071385 30417 raft_consensus.cc:2454] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3eb1a81f6d4409887715b39decd4c65 in term 1.
I20260812 02:43:29.074326 29650 catalog_manager.cc:5495] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3eb1a81f6d4409887715b39decd4c65 (127.10.75.66). New cstate: current_term: 1 leader_uuid: "b3eb1a81f6d4409887715b39decd4c65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9bc1a3725f54e08a3f01b83119b49a0" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 38447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0b2c989d5c4f7687a22e68b3301ae4" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3eb1a81f6d4409887715b39decd4c65" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41977 } health_report { overall_health: HEALTHY } } }
I20260812 02:43:29.111545 30519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:29.107893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37276 (local address 127.10.75.66:41977)
0812 02:43:29.108021 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 02:43:29.108026 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:43:29.108049 (+ 23us) server_negotiation.cc:407] Connection header received
0812 02:43:29.108124 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:43:29.108126 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:43:29.108181 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:43:29.108272 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:43:29.108574 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:29.109099 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:29.110180 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:43:29.110420 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:43:29.110514 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:43:29.110794 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:43:29.111215 (+ 421us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:43:29.111307 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 02:43:29.111365 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 02:43:29.111414 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 02:43:29.117427 30417 raft_consensus.cc:1261] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4 [term 1 FOLLOWER]: Refusing update from remote peer b3eb1a81f6d4409887715b39decd4c65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:43:29.117496 29928 raft_consensus.cc:1261] T 161860a81bda4200a0ab8106ed848430 P f9bc1a3725f54e08a3f01b83119b49a0 [term 1 FOLLOWER]: Refusing update from remote peer b3eb1a81f6d4409887715b39decd4c65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:43:29.118250 30538 consensus_queue.cc:1035] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0b2c989d5c4f7687a22e68b3301ae4" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:43:29.118477 30545 consensus_queue.cc:1035] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9bc1a3725f54e08a3f01b83119b49a0" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 38447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:43:29.127322 30555 mvcc.cc:205] Tried to move back new op lower bound from 7317514686937165824 to 7317514686757462016. Current Snapshot: MvccSnapshot[applied={T|T < 7317514686937165824}]
I20260812 02:43:29.130685 30556 mvcc.cc:205] Tried to move back new op lower bound from 7317514686937165824 to 7317514686757462016. Current Snapshot: MvccSnapshot[applied={T|T < 7317514686937165824 or (T in {7317514686937165824})}]
I20260812 02:43:29.136500 29649 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60512:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:43:29.136669 29649 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60512:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:43:29.139314 29649 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1a0b73535b8b4698bb5d551f0aeb39f8: Sending DeleteTablet for 3 replicas of tablet 161860a81bda4200a0ab8106ed848430
I20260812 02:43:29.140301 29883 tablet_service.cc:1514] Processing DeleteTablet for tablet 161860a81bda4200a0ab8106ed848430 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:43:29 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:46028
I20260812 02:43:29.140321 30387 tablet_service.cc:1514] Processing DeleteTablet for tablet 161860a81bda4200a0ab8106ed848430 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:43:29 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:43516
I20260812 02:43:29.141016 30148 tablet_service.cc:1514] Processing DeleteTablet for tablet 161860a81bda4200a0ab8106ed848430 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:43:29 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:37274
I20260812 02:43:29.141214 30572 tablet_replica.cc:330] T 161860a81bda4200a0ab8106ed848430 P f9bc1a3725f54e08a3f01b83119b49a0: stopping tablet replica
I20260812 02:43:29.141526 30572 raft_consensus.cc:2229] T 161860a81bda4200a0ab8106ed848430 P f9bc1a3725f54e08a3f01b83119b49a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:43:29.141623 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 29767
I20260812 02:43:29.146273 30574 tablet_replica.cc:330] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65: stopping tablet replica
I20260812 02:43:29.146647 30574 raft_consensus.cc:2229] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:43:29.147109 30574 raft_consensus.cc:2258] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:43:29.151767 30574 ts_tablet_manager.cc:1905] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:43:29.154686 30574 ts_tablet_manager.cc:1918] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:43:29.154805 30574 log.cc:1196] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/161860a81bda4200a0ab8106ed848430
I20260812 02:43:29.155117 30573 tablet_replica.cc:330] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4: stopping tablet replica
I20260812 02:43:29.155198 30574 ts_tablet_manager.cc:1939] T 161860a81bda4200a0ab8106ed848430 P b3eb1a81f6d4409887715b39decd4c65: Deleting consensus metadata
I20260812 02:43:29.155534 30573 raft_consensus.cc:2229] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:43:29.155925 30573 raft_consensus.cc:2258] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:43:29.156569 29628 catalog_manager.cc:4841] TS b3eb1a81f6d4409887715b39decd4c65 (127.10.75.66:41977): tablet 161860a81bda4200a0ab8106ed848430 (table test-table [id=96c28d6da66f4430a8e996fb574b192a]) successfully deleted
I20260812 02:43:29.157655 30573 ts_tablet_manager.cc:1905] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 02:43:29.159214 29628 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.75.65:38447 (error 108)
I20260812 02:43:29.160463 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 30024
I20260812 02:43:29.160887 30522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:43:29.160523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:38447 (local address 127.0.0.1:46038)
0812 02:43:29.160729 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 02:43:29.160797 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.65:38447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
W20260812 02:43:29.167188 29628 catalog_manager.cc:4584] TS f9bc1a3725f54e08a3f01b83119b49a0 (127.10.75.65:38447): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 161860a81bda4200a0ab8106ed848430: Network error: Client connection negotiation failed: client connection to 127.10.75.65:38447: connect: Connection refused (error 111)
I20260812 02:43:29.167495 30573 ts_tablet_manager.cc:1918] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:43:29.167634 30573 log.cc:1196] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/161860a81bda4200a0ab8106ed848430
I20260812 02:43:29.167961 30573 ts_tablet_manager.cc:1939] T 161860a81bda4200a0ab8106ed848430 P 9d0b2c989d5c4f7687a22e68b3301ae4: Deleting consensus metadata
I20260812 02:43:29.169651 29628 catalog_manager.cc:4841] TS 9d0b2c989d5c4f7687a22e68b3301ae4 (127.10.75.67:43835): tablet 161860a81bda4200a0ab8106ed848430 (table test-table [id=96c28d6da66f4430a8e996fb574b192a]) successfully deleted
I20260812 02:43:29.174181 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 30269
I20260812 02:43:29.190663 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 29600
2026-08-12T02:43:29Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2696 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:43:29 dist-test-slave-2p8l krb5kdc[30579](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:43:29 dist-test-slave-2p8l krb5kdc[30579](info): set up 2 sockets
Aug 12 02:43:29 dist-test-slave-2p8l krb5kdc[30579](info): commencing operation
krb5kdc: starting...
W20260812 02:43:30.503875 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:43:30 dist-test-slave-2p8l krb5kdc[30579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:43:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:43:30Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.10.75.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.10.75.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.10.75.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/rangeradmin_127.10.75.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.10.75.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/rangeradmin_127.10.75.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.10.75.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.10.75.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.10.75.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/rangerlookup_127.10.75.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.10.75.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/rangerlookup_127.10.75.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.75.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.10.75.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.75.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/HTTP_127.10.75.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.75.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/HTTP_127.10.75.84@KRBTEST.COM.keytab.
I20260812 02:43:30.685772 10541 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskWpp1yo/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/postgres -l logfile start
2026-08-12 02:43:33.317 UTC [30637] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 02:43:33.317 UTC [30637] LOG: listening on IPv4 address "127.10.75.84", port 51293
2026-08-12 02:43:33.321 UTC [30637] LOG: listening on Unix socket "/tmp/.s.PGSQL.51293"
2026-08-12 02:43:33.364 UTC [30646] LOG: database system was shut down at 2026-08-12 02:43:31 UTC
2026-08-12 02:43:33.369 UTC [30637] LOG: database system is ready to accept connections
I20260812 02:43:34.623857 10541 mini_postgres.cc:96] Postgres bound to 51293
2026-08-12 02:43:34.634 UTC [30657] FATAL: database "slave" does not exist
127.10.75.84:51293 - accepting connections
I20260812 02:43:34.635470 10541 mini_ranger.cc:161] Starting Ranger...
I20260812 02:43:34.656019 10541 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 02:43:35.172089 10541 mini_ranger.cc:87] Created ranger Postgres database
I20260812 02:43:35.172271 10541 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ranger-admin
2026-08-12 02:43:35,539 [I] DB FLAVOR :POSTGRES
2026-08-12 02:43:35,540 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 02:43:35,540 [I] Checking connection..
2026-08-12 02:43:35,540 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 02:43:35,822 [I] Checking connection passed.
2026-08-12 02:43:35,822 [I] --------- Verifying version history table ---------
2026-08-12 02:43:35,822 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 02:43:36,088 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 02:43:36,088 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 02:43:36,325 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 02:43:36,326 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 02:43:36,326 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 02:43:36.588 UTC [30782] WARNING: there is no transaction in progress
2026-08-12 02:43:36,597 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 02:43:36,598 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 02:43:36,853 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 02:43:36,854 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 02:43:36,854 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 02:43:37,108 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 02:43:37,344 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-2p8l.c.gcp-upstream.internal','N') ;"
2026-08-12 02:43:37,603 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 02:43:37,870 [I] Table x_portal_user does not exist in database ranger
2026-08-12 02:43:37,870 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 02:43:38,119 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 02:43:38,119 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 02:43:38,378 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 02:43:38,612 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 02:43:38,613 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 02:43:39.661 UTC [30983] WARNING: there is no transaction in progress
2026-08-12 02:43:39.679 UTC [30983] WARNING: there is no transaction in progress
2026-08-12 02:43:39.696 UTC [30983] WARNING: there is no transaction in progress
2026-08-12 02:43:39.713 UTC [30983] WARNING: there is no transaction in progress
2026-08-12 02:43:39.731 UTC [30983] WARNING: there is no transaction in progress
2026-08-12 02:43:39.750 UTC [30983] WARNING: there is no transaction in progress
2026-08-12 02:43:39.812 UTC [30983] WARNING: there is no transaction in progress
2026-08-12 02:43:39.819 UTC [30983] WARNING: there is no transaction in progress
2026-08-12 02:43:39.835 UTC [30983] WARNING: there is no transaction in progress
2026-08-12 02:43:39.846 UTC [30983] WARNING: there is no transaction in progress
2026-08-12 02:43:39.856 UTC [30983] WARNING: there is no transaction in progress
2026-08-12 02:43:39.872 UTC [30983] WARNING: there is no transaction in progress
2026-08-12 02:43:39.883 UTC [30983] WARNING: there is no transaction in progress
2026-08-12 02:43:39.890 UTC [30983] WARNING: there is no transaction in progress
2026-08-12 02:43:39.897 UTC [30983] WARNING: there is no transaction in progress
2026-08-12 02:43:39.903 UTC [30983] WARNING: there is no transaction in progress
2026-08-12 02:43:40,612 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 02:43:40,613 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 02:43:40,898 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 02:43:40,898 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 02:43:41,191 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 02:43:41,192 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 02:43:41,494 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 02:43:41,494 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 02:43:41,747 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 02:43:42,011 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-2p8l.c.gcp-upstream.internal';"
2026-08-12 02:43:42,255 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 02:43:42,255 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 02:43:42,537 [I] DB_PATCHES have already been applied
I20260812 02:43:42.543921 10541 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ranger-admin:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskWpp1yo/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 02:43:42.543995 10541 mini_ranger.cc:193] Using host: 127.10.75.84
I20260812 02:43:42.548837 10541 mini_ranger.cc:227] Ranger admin URL: http://127.10.75.84:47355
Aug 12, 2026 2:43:42 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 2:43:42 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 2:43:43 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 2:43:43 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 2:43:43 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 2:43:43 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 2:43:43 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 02:43:43.996105 10541 mini_ranger.cc:160] Time spent starting Ranger: real 9.361s user 0.000s sys 0.016s
Aug 12, 2026 2:44:04 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 2:44:04 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 2:44:04 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 2:44:04 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 2:44:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 2:44:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 2:44:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 2:44:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 2:44:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 2:44:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 2:44:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 2:44:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 2:44:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 2:44:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 2:44:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 2:44:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 2:44:04 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 2:44:04 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 02:44:05.455235 10541 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.10.75.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.10.75.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.10.75.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/rangerkms_127.10.75.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.10.75.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/rangerkms_127.10.75.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.75.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.10.75.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.75.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/HTTP_127.10.75.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.75.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/HTTP_127.10.75.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 02:44:05 dist-test-slave-2p8l krb5kdc[30579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502645, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 02:44:05.540457 10541 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 02:44:05.550616 10541 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 02:44:06.488412 10541 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 02:44:06.488517 10541 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ranger-kms
I20260812 02:44:06.488617 10541 mini_ranger_kms.cc:227] Using postgres at 127.10.75.84:51293
2026-08-12 02:44:07,115 [I] DB FLAVOR :POSTGRES
2026-08-12 02:44:07,115 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 02:44:07,115 [I] Checking connection
2026-08-12 02:44:07,115 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 02:44:07,389 [I] connection success
2026-08-12 02:44:07,389 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 02:44:07,390 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 02:44:07,390 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 02:44:07,629 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 02:44:07,630 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 02:44:07,630 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 02:44:07,630 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:51293/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 02:44:07,894 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 02:44:08.385442 10541 mini_ranger_kms.cc:310] Created kms service
I20260812 02:44:08.558252 10541 mini_ranger_kms.cc:326] Created kudu user
I20260812 02:44:08.599967 10541 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 02:44:08 dist-test-slave-2p8l krb5kdc[30579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502645, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
I20260812 02:44:08.977263 10541 mini_ranger_kms.cc:384] Added ranger policy
I20260812 02:44:08.977420 10541 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ranger-kms:/tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 02:44:08.977445 10541 mini_ranger_kms.cc:240] Using host: 127.10.75.84
I20260812 02:44:08.982939 10541 mini_ranger_kms.cc:276] Ranger KMS PID: 31314
I20260812 02:44:08.983080 10541 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.10.75.84:48779
Aug 12, 2026 2:44:10 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 2:44:10 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 2:44:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 2:44:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 2:44:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 2:44:10 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 02:44:11 dist-test-slave-2p8l krb5kdc[30579](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786502651, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.75.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 12 02:44:11 dist-test-slave-2p8l krb5kdc[30579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502651, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.75.84@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
I20260812 02:44:12.006847 10541 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.466s user 0.018s sys 0.249s
I20260812 02:44:12.006973 10541 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 02:44:12.007072 10541 mini_ranger_kms.cc:401] 127.10.75.84:48779/kms/v1/keys
Aug 12 02:44:12 dist-test-slave-2p8l krb5kdc[30579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502651, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.75.84@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
Aug 12 02:44:14 dist-test-slave-2p8l krb5kdc[30579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:44:14.465204 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:39899
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:34395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:39899
--ranger_config_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.75.84:48779/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:44:14.578430 31404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:44:14.578687 31404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:44:14.578727 31404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:44:14.582733 31404 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:44:14.582793 31404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:44:14.582813 31404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:44:14.582861 31404 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:44:14.582883 31404 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:44:14.588356 31404 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:34395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/master-0/wal
--ranger_kms_url=127.10.75.84:48779/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:39899
--ranger_config_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:39899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:44:14.589416 31404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:44:14.590459 31404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:44:14.599033 31415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:44:14.599033 31416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:44:14.599068 31422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:44:14.599460 31404 server_base.cc:1034] running on GCE node
I20260812 02:44:14.600028 31404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:44:14.601197 31404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:44:14.602413 31404 hybrid_clock.cc:648] HybridClock initialized: now 1786502654602395 us; error 35 us; skew 500 ppm
Aug 12 02:44:14 dist-test-slave-2p8l krb5kdc[30579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502654, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:44:14.628511 31404 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:44:14.629578 31404 webserver.cc:460] Webserver started at http://127.10.75.126:43901/ using document root <none> and password file <none>
I20260812 02:44:14.630203 31404 fs_manager.cc:359] Metadata directory not provided
I20260812 02:44:14.630270 31404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:44:14.630452 31404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 02:44:14 dist-test-slave-2p8l krb5kdc[30579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502654, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
I20260812 02:44:14.685384 31404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "6757a8f339964971af0434fbe4f0f40a"
format_stamp: "Formatted at 2026-08-12 02:44:14 on dist-test-slave-2p8l"
server_key: "16ff67754113585468c70ebd4a46900e"
server_key_iv: "f4089d0d4bda1cf359b361dd6a70e4bd"
server_key_version: "kuduclusterkey@0"
I20260812 02:44:14.686244 31404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "6757a8f339964971af0434fbe4f0f40a"
format_stamp: "Formatted at 2026-08-12 02:44:14 on dist-test-slave-2p8l"
server_key: "16ff67754113585468c70ebd4a46900e"
server_key_iv: "f4089d0d4bda1cf359b361dd6a70e4bd"
server_key_version: "kuduclusterkey@0"
I20260812 02:44:14.691234 31404 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 02:44:14.708158 31440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:44:14.709743 31404 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 02:44:14.709901 31404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "6757a8f339964971af0434fbe4f0f40a"
format_stamp: "Formatted at 2026-08-12 02:44:14 on dist-test-slave-2p8l"
server_key: "16ff67754113585468c70ebd4a46900e"
server_key_iv: "f4089d0d4bda1cf359b361dd6a70e4bd"
server_key_version: "kuduclusterkey@0"
I20260812 02:44:14.710042 31404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:44:14.733347 31404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:44:14.736604 31404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:44:14.736809 31404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:44:14.745393 31404 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:39899
I20260812 02:44:14.745463 31537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:39899 every 8 connection(s)
I20260812 02:44:14.746526 31404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:44:14.749455 31538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:44:14.754485 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 31404
I20260812 02:44:14.754624 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:44:14.754914 10541 external_mini_cluster.cc:1428] Setting key 3cd54d5f6b39727e42ed2497606cba24
I20260812 02:44:14.756209 31538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a: Bootstrap starting.
I20260812 02:44:14.758683 31538 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a: Neither blocks nor log segments found. Creating new log.
I20260812 02:44:14.759711 31538 log.cc:824] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a: Log is configured to *not* fsync() on all Append() calls
I20260812 02:44:14.761689 31538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a: No bootstrap required, opened a new log
Aug 12 02:44:14 dist-test-slave-2p8l krb5kdc[30579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:44:14.766201 31538 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6757a8f339964971af0434fbe4f0f40a" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39899 } }
I20260812 02:44:14.766464 31538 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:44:14.766577 31538 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6757a8f339964971af0434fbe4f0f40a, State: Initialized, Role: FOLLOWER
I20260812 02:44:14.767194 31538 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6757a8f339964971af0434fbe4f0f40a" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39899 } }
I20260812 02:44:14.767366 31538 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:44:14.767472 31538 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:44:14.767617 31538 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:44:14.768818 31538 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6757a8f339964971af0434fbe4f0f40a" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39899 } }
I20260812 02:44:14.769197 31538 leader_election.cc:302] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6757a8f339964971af0434fbe4f0f40a; no voters:
I20260812 02:44:14.769580 31538 leader_election.cc:288] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:44:14.769721 31545 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:44:14.769984 31545 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a [term 1 LEADER]: Becoming Leader. State: Replica: 6757a8f339964971af0434fbe4f0f40a, State: Running, Role: LEADER
I20260812 02:44:14.770368 31545 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6757a8f339964971af0434fbe4f0f40a" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39899 } }
I20260812 02:44:14.771016 31538 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:44:14.771803 31545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6757a8f339964971af0434fbe4f0f40a. Latest consensus state: current_term: 1 leader_uuid: "6757a8f339964971af0434fbe4f0f40a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6757a8f339964971af0434fbe4f0f40a" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39899 } } }
I20260812 02:44:14.771806 31546 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6757a8f339964971af0434fbe4f0f40a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6757a8f339964971af0434fbe4f0f40a" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39899 } } }
I20260812 02:44:14.772050 31546 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a [sys.catalog]: This master's current role is: LEADER
I20260812 02:44:14.772050 31545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a [sys.catalog]: This master's current role is: LEADER
I20260812 02:44:14.772485 31542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:14.756410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57926 (local address 127.10.75.126:39899)
0812 02:44:14.756896 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0812 02:44:14.756915 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 02:44:14.756960 (+ 45us) server_negotiation.cc:407] Connection header received
0812 02:44:14.757803 (+ 843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:44:14.757827 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:44:14.758318 (+ 491us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:44:14.758676 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:44:14.759599 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:14.761135 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:14.762328 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:14.763023 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:14.763203 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:44:14.766436 (+ 3233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:44:14.766443 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:44:14.766459 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:44:14.766493 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:44:14.768582 (+ 2089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:44:14.769113 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:44:14.769119 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:44:14.769125 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:44:14.769257 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:44:14.769640 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:44:14.769646 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:44:14.769649 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:44:14.770194 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:44:14.770972 (+ 778us) server_negotiation.cc:1035] Waiting for connection context
0812 02:44:14.771143 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 02:44:14.771432 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":133,"threads_started":1}
I20260812 02:44:14.773392 31538 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 02:44:14.774995 31560 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:44:14.781124 31560 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:44:14.791435 31560 catalog_manager.cc:1347] Generated new cluster ID: 20bde4415ea04b81bfb205ad890ceefe
I20260812 02:44:14.791530 31560 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:44:14.816015 31560 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:44:14.817339 31560 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:44:14.825740 31560 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a: Generated new TSK 0
I20260812 02:44:14.826474 31560 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
I20260812 02:44:15.522325 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.75.84:48779/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:39899
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:34395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:44:15.690265 31613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:44:15.690646 31613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:44:15.690722 31613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:44:15.697398 31613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:44:15.697479 31613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:44:15.697575 31613 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:44:15.705633 31613 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:34395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.10.75.84:48779/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:39899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:44:15.706952 31613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:44:15.708304 31613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:44:15.719705 31627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:44:15.719707 31629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:44:15.719981 31613 server_base.cc:1034] running on GCE node
W20260812 02:44:15.720182 31625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:44:15.720629 31613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:44:15.721371 31613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:44:15.722573 31613 hybrid_clock.cc:648] HybridClock initialized: now 1786502655722540 us; error 43 us; skew 500 ppm
Aug 12 02:44:15 dist-test-slave-2p8l krb5kdc[30579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502655, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:44:15.725965 31613 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:44:15.726787 31613 webserver.cc:460] Webserver started at http://127.10.75.65:41177/ using document root <none> and password file <none>
I20260812 02:44:15.727344 31613 fs_manager.cc:359] Metadata directory not provided
I20260812 02:44:15.727406 31613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:44:15.727626 31613 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 02:44:15 dist-test-slave-2p8l krb5kdc[30579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502655, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
I20260812 02:44:15.740506 31613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "05baf6a2b10d41738038ddf12577826f"
format_stamp: "Formatted at 2026-08-12 02:44:15 on dist-test-slave-2p8l"
server_key: "f728d985b528c786718a5a0841ec598f"
server_key_iv: "5b2d399d0036fc8acb4591834c124b87"
server_key_version: "kuduclusterkey@0"
I20260812 02:44:15.741568 31613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "05baf6a2b10d41738038ddf12577826f"
format_stamp: "Formatted at 2026-08-12 02:44:15 on dist-test-slave-2p8l"
server_key: "f728d985b528c786718a5a0841ec598f"
server_key_iv: "5b2d399d0036fc8acb4591834c124b87"
server_key_version: "kuduclusterkey@0"
I20260812 02:44:15.746945 31613 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 02:44:15.782464 31643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:44:15.792879 31613 fs_manager.cc:725] Time spent opening block manager: real 0.027s user 0.004s sys 0.000s
I20260812 02:44:15.793054 31613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "05baf6a2b10d41738038ddf12577826f"
format_stamp: "Formatted at 2026-08-12 02:44:15 on dist-test-slave-2p8l"
server_key: "f728d985b528c786718a5a0841ec598f"
server_key_iv: "5b2d399d0036fc8acb4591834c124b87"
server_key_version: "kuduclusterkey@0"
I20260812 02:44:15.793217 31613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:44:15.825307 31613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:44:15.829332 31613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:44:15.829623 31613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:44:15.830417 31613 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:44:15.831535 31613 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:44:15.831658 31613 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:44:15.831791 31613 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:44:15.831876 31613 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:44:15.844540 31613 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:37399
I20260812 02:44:15.844681 31846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:37399 every 8 connection(s)
I20260812 02:44:15.845800 31613 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:44:15.852636 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 31613
I20260812 02:44:15.852806 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:44:15.853128 10541 external_mini_cluster.cc:1428] Setting key dd02f3af9f02edac5ba070226bc673a5
Aug 12 02:44:15 dist-test-slave-2p8l krb5kdc[30579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502655, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:44:15.865582 31850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:15.848684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:39899 (local address 127.10.75.65:57131)
0812 02:44:15.849256 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0812 02:44:15.849313 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 02:44:15.850443 (+ 1130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:44:15.851238 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:44:15.851246 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:44:15.851637 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:44:15.852311 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:44:15.852333 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:44:15.853771 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:44:15.853774 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:44:15.855777 (+ 2003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:44:15.855789 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:44:15.856545 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:44:15.856549 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:44:15.856756 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:44:15.857541 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:44:15.857561 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:44:15.859384 (+ 1823us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:44:15.862115 (+ 2731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:44:15.862122 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:44:15.862137 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:44:15.862544 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:44:15.862891 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:44:15.862894 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:44:15.862897 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:44:15.863071 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:44:15.863607 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:44:15.863616 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:44:15.863938 (+ 322us) client_negotiation.cc:769] Sending connection context
0812 02:44:15.864133 (+ 195us) client_negotiation.cc:240] Negotiation successful
0812 02:44:15.864493 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":156,"threads_started":1}
I20260812 02:44:15.866465 31849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:15.848195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:57131 (local address 127.10.75.126:39899)
0812 02:44:15.848458 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0812 02:44:15.848462 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:44:15.849424 (+ 962us) server_negotiation.cc:407] Connection header received
0812 02:44:15.850693 (+ 1269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:44:15.850697 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:44:15.850756 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:44:15.850818 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:44:15.852509 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:15.853402 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:15.855919 (+ 2517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:15.856275 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:15.856347 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:44:15.859605 (+ 3258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:44:15.859609 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:44:15.859612 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:44:15.859640 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:44:15.861898 (+ 2258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:44:15.862671 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:44:15.862674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:44:15.862676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:44:15.862778 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:44:15.863202 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:44:15.863206 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:44:15.863208 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:44:15.863454 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:44:15.863547 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 02:44:15.866139 (+ 2592us) server_negotiation.cc:299] Negotiation successful
0812 02:44:15.866294 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":86,"threads_started":1}
I20260812 02:44:15.867810 31847 heartbeater.cc:347] Connected to a master server at 127.10.75.126:39899
I20260812 02:44:15.868113 31847 heartbeater.cc:464] Registering TS with master...
I20260812 02:44:15.868721 31847 heartbeater.cc:511] Master 127.10.75.126:39899 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.75.66@KRBTEST.COM; defaulting to no policy
I20260812 02:44:15.870584 31467 ts_manager.cc:194] Registered new tserver with Master: 05baf6a2b10d41738038ddf12577826f (127.10.75.65:37399)
I20260812 02:44:15.872112 31467 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:57131
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
I20260812 02:44:15.892786 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.75.84:48779/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:39899
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:34395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 02:44:15 dist-test-slave-2p8l krb5kdc[30579](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786502655, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 02:44:16.023943 31857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:44:16.024221 31857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:44:16.024327 31857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:44:16.028518 31857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:44:16.028606 31857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:44:16.028712 31857 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:44:16.034036 31857 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:34395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.10.75.84:48779/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:39899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31857
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:44:16.035164 31857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:44:16.036284 31857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:44:16.046200 31870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:44:16.046147 31871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:44:16.046552 31873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:44:16.047135 31857 server_base.cc:1034] running on GCE node
I20260812 02:44:16.047807 31857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:44:16.048629 31857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:44:16.049829 31857 hybrid_clock.cc:648] HybridClock initialized: now 1786502656049800 us; error 48 us; skew 500 ppm
Aug 12 02:44:16 dist-test-slave-2p8l krb5kdc[30579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502656, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:44:16.053162 31857 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:44:16.054141 31857 webserver.cc:460] Webserver started at http://127.10.75.66:43447/ using document root <none> and password file <none>
I20260812 02:44:16.054723 31857 fs_manager.cc:359] Metadata directory not provided
I20260812 02:44:16.054816 31857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:44:16.055115 31857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 02:44:16 dist-test-slave-2p8l krb5kdc[30579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502656, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
I20260812 02:44:16.071305 31857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "8a0413d823744805bcb65d0a3c2b0650"
format_stamp: "Formatted at 2026-08-12 02:44:16 on dist-test-slave-2p8l"
server_key: "db824bc308cc1507216e001919c66dd1"
server_key_iv: "fc839bd3d4cc471cb49e74817734ea10"
server_key_version: "kuduclusterkey@0"
I20260812 02:44:16.072211 31857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "8a0413d823744805bcb65d0a3c2b0650"
format_stamp: "Formatted at 2026-08-12 02:44:16 on dist-test-slave-2p8l"
server_key: "db824bc308cc1507216e001919c66dd1"
server_key_iv: "fc839bd3d4cc471cb49e74817734ea10"
server_key_version: "kuduclusterkey@0"
I20260812 02:44:16.084254 31857 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.004s sys 0.000s
I20260812 02:44:16.110179 31887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:44:16.111923 31857 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.004s sys 0.000s
I20260812 02:44:16.112072 31857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "8a0413d823744805bcb65d0a3c2b0650"
format_stamp: "Formatted at 2026-08-12 02:44:16 on dist-test-slave-2p8l"
server_key: "db824bc308cc1507216e001919c66dd1"
server_key_iv: "fc839bd3d4cc471cb49e74817734ea10"
server_key_version: "kuduclusterkey@0"
I20260812 02:44:16.112219 31857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:44:16.143855 31857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:44:16.155730 31857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:44:16.156006 31857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:44:16.156782 31857 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:44:16.157894 31857 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:44:16.158007 31857 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:44:16.158139 31857 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:44:16.158213 31857 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:44:16.171172 31857 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:41797
I20260812 02:44:16.172429 31857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:44:16.178329 32099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:41797 every 8 connection(s)
I20260812 02:44:16.178807 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 31857
I20260812 02:44:16.178938 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:44:16.179236 10541 external_mini_cluster.cc:1428] Setting key f1a861e922e63f2d0b442a3333ec47fb
Aug 12 02:44:16 dist-test-slave-2p8l krb5kdc[30579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502656, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:44:16.193311 32109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:16.176536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:39899 (local address 127.10.75.66:47057)
0812 02:44:16.178837 (+ 2301us) negotiation.cc:107] Waiting for socket to connect
0812 02:44:16.178892 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 02:44:16.180015 (+ 1123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:44:16.180800 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:44:16.180808 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:44:16.181176 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:44:16.181812 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:44:16.181830 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.182929 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.182931 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:44:16.184250 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:44:16.184263 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.185020 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.185024 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:44:16.185210 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:44:16.185915 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:44:16.185935 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:44:16.187679 (+ 1744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:44:16.189914 (+ 2235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:44:16.189921 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:44:16.189937 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:44:16.190320 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:44:16.190654 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:44:16.190657 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:44:16.190658 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:44:16.190844 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:44:16.191366 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:44:16.191372 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:44:16.191683 (+ 311us) client_negotiation.cc:769] Sending connection context
0812 02:44:16.191884 (+ 201us) client_negotiation.cc:240] Negotiation successful
0812 02:44:16.192228 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2071,"thread_start_us":132,"threads_started":1}
I20260812 02:44:16.193401 31849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:16.177665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:47057 (local address 127.10.75.126:39899)
0812 02:44:16.177792 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 02:44:16.177796 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:44:16.179023 (+ 1227us) server_negotiation.cc:407] Connection header received
0812 02:44:16.180284 (+ 1261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:44:16.180288 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:44:16.180345 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:44:16.180397 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:44:16.181983 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.182767 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.184391 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.184751 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.184821 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:44:16.187877 (+ 3056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:44:16.187882 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:44:16.187885 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:44:16.187913 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:44:16.189771 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:44:16.190447 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:44:16.190451 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:44:16.190452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:44:16.190545 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:44:16.190959 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:44:16.190962 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:44:16.190964 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:44:16.191212 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:44:16.191308 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 02:44:16.193085 (+ 1777us) server_negotiation.cc:299] Negotiation successful
0812 02:44:16.193220 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 02:44:16.194543 32105 heartbeater.cc:347] Connected to a master server at 127.10.75.126:39899
I20260812 02:44:16.194793 32105 heartbeater.cc:464] Registering TS with master...
I20260812 02:44:16.195367 32105 heartbeater.cc:511] Master 127.10.75.126:39899 requested a full tablet report, sending...
I20260812 02:44:16.196436 31467 ts_manager.cc:194] Registered new tserver with Master: 8a0413d823744805bcb65d0a3c2b0650 (127.10.75.66:41797)
I20260812 02:44:16.197014 31467 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:47057
WARNING: no policy specified for kudu/127.10.75.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
I20260812 02:44:16.236727 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.75.84:48779/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:39899
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:34395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:44:16.422119 32113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:44:16.422528 32113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:44:16.422654 32113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:44:16.428998 32113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:44:16.429140 32113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:44:16.429286 32113 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
Aug 12 02:44:16 dist-test-slave-2p8l krb5kdc[30579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502655, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
I20260812 02:44:16.437143 32113 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:34395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.10.75.84:48779/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:39899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32113
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:44:16.438453 32113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:44:16.439750 32113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:44:16.453105 32124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:44:16.453110 32123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:44:16.454201 32126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:44:16.454341 32113 server_base.cc:1034] running on GCE node
I20260812 02:44:16.454964 32113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:44:16.455739 32113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:44:16.456921 32113 hybrid_clock.cc:648] HybridClock initialized: now 1786502656456856 us; error 82 us; skew 500 ppm
Aug 12 02:44:16 dist-test-slave-2p8l krb5kdc[30579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502656, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:44:16.460707 32113 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:44:16.461757 32113 webserver.cc:460] Webserver started at http://127.10.75.67:45047/ using document root <none> and password file <none>
I20260812 02:44:16.462436 32113 fs_manager.cc:359] Metadata directory not provided
I20260812 02:44:16.462513 32113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:44:16.462730 32113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 02:44:16 dist-test-slave-2p8l krb5kdc[30579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502656, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
I20260812 02:44:16.488011 32113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "e7b1c893fa2f4298a4c1df2065a4974e"
format_stamp: "Formatted at 2026-08-12 02:44:16 on dist-test-slave-2p8l"
server_key: "4f2fc06003916ea8f75289e0ce6a678e"
server_key_iv: "bf3ee14a00040114749d4e814266468b"
server_key_version: "kuduclusterkey@0"
I20260812 02:44:16.488801 32113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "e7b1c893fa2f4298a4c1df2065a4974e"
format_stamp: "Formatted at 2026-08-12 02:44:16 on dist-test-slave-2p8l"
server_key: "4f2fc06003916ea8f75289e0ce6a678e"
server_key_iv: "bf3ee14a00040114749d4e814266468b"
server_key_version: "kuduclusterkey@0"
I20260812 02:44:16.497373 32113 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.002s sys 0.005s
I20260812 02:44:16.516978 32135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:44:16.520884 32113 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.003s sys 0.000s
I20260812 02:44:16.521188 32113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "e7b1c893fa2f4298a4c1df2065a4974e"
format_stamp: "Formatted at 2026-08-12 02:44:16 on dist-test-slave-2p8l"
server_key: "4f2fc06003916ea8f75289e0ce6a678e"
server_key_iv: "bf3ee14a00040114749d4e814266468b"
server_key_version: "kuduclusterkey@0"
I20260812 02:44:16.521435 32113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:44:16.557302 32113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:44:16.561041 32113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:44:16.561336 32113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:44:16.562110 32113 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:44:16.563248 32113 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:44:16.563364 32113 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:44:16.563473 32113 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:44:16.563546 32113 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:44:16.586613 32113 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:34185
I20260812 02:44:16.587802 32113 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:44:16.588618 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 32113
I20260812 02:44:16.588735 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:44:16.589012 10541 external_mini_cluster.cc:1428] Setting key 6505ea4a29bb4482dd78a3cae4404da4
I20260812 02:44:16.595300 32348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:34185 every 8 connection(s)
Aug 12 02:44:16 dist-test-slave-2p8l krb5kdc[30579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502656, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:44:16.621236 31849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:16.601214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:46177 (local address 127.10.75.126:39899)
0812 02:44:16.601348 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 02:44:16.601352 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:44:16.606997 (+ 5645us) server_negotiation.cc:407] Connection header received
0812 02:44:16.608206 (+ 1209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:44:16.608210 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:44:16.608262 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:44:16.608311 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:44:16.609894 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.610705 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.612300 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.612609 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.612679 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:44:16.616894 (+ 4215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:44:16.616898 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:44:16.616901 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:44:16.616929 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:44:16.618808 (+ 1879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:44:16.619499 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:44:16.619502 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:44:16.619504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:44:16.619598 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:44:16.619983 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:44:16.619986 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:44:16.619988 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:44:16.620201 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:44:16.620271 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 02:44:16.620952 (+ 681us) server_negotiation.cc:299] Negotiation successful
0812 02:44:16.621075 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 02:44:16.623208 32352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:16.601780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:39899 (local address 127.10.75.67:46177)
0812 02:44:16.606832 (+ 5052us) negotiation.cc:107] Waiting for socket to connect
0812 02:44:16.606894 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 02:44:16.607945 (+ 1051us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:44:16.608713 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:44:16.608722 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:44:16.609092 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:44:16.609737 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:44:16.609754 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.610858 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.610861 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:44:16.612163 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:44:16.612174 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.612879 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.612883 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:44:16.613082 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:44:16.614773 (+ 1691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:44:16.614794 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:44:16.616709 (+ 1915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:44:16.618955 (+ 2246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:44:16.618960 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:44:16.618979 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:44:16.619383 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:44:16.619706 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:44:16.619709 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:44:16.619711 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:44:16.619880 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:44:16.620351 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:44:16.620358 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:44:16.620680 (+ 322us) client_negotiation.cc:769] Sending connection context
0812 02:44:16.621778 (+ 1098us) client_negotiation.cc:240] Negotiation successful
0812 02:44:16.622151 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4804,"thread_start_us":216,"threads_started":1}
I20260812 02:44:16.624699 32349 heartbeater.cc:347] Connected to a master server at 127.10.75.126:39899
I20260812 02:44:16.624938 32349 heartbeater.cc:464] Registering TS with master...
I20260812 02:44:16.625491 32349 heartbeater.cc:511] Master 127.10.75.126:39899 requested a full tablet report, sending...
I20260812 02:44:16.628113 31467 ts_manager.cc:194] Registered new tserver with Master: e7b1c893fa2f4298a4c1df2065a4974e (127.10.75.67:34185)
I20260812 02:44:16.628841 31467 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:46177
I20260812 02:44:16.639206 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:44:16.668386 31849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:16.646710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51922 (local address 127.10.75.126:39899)
0812 02:44:16.646839 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 02:44:16.646844 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:44:16.658428 (+ 11584us) server_negotiation.cc:407] Connection header received
0812 02:44:16.658673 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:44:16.658677 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:44:16.658733 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:44:16.658786 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:44:16.659842 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.660678 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.661993 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.662366 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.662450 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:44:16.664412 (+ 1962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:44:16.664416 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:44:16.664419 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:44:16.664447 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:44:16.666311 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:44:16.666879 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:44:16.666883 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:44:16.666885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:44:16.666982 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:44:16.667338 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:44:16.667341 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:44:16.667343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:44:16.667574 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:44:16.667683 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 02:44:16.668088 (+ 405us) server_negotiation.cc:299] Negotiation successful
0812 02:44:16.668212 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 02:44:16.672757 31467 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51922:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:44:16.677603 31467 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:44:16.742889 32372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:16.724457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:37399 (local address 127.0.0.1:48460)
0812 02:44:16.729667 (+ 5210us) negotiation.cc:107] Waiting for socket to connect
0812 02:44:16.729727 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 02:44:16.729868 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:44:16.732876 (+ 3008us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:44:16.732879 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:44:16.732898 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:44:16.732981 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:44:16.732987 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.737670 (+ 4683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.737673 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:44:16.738874 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:44:16.738885 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.742218 (+ 3333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.742222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:44:16.742442 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:44:16.742484 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 02:44:16.742595 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 02:44:16.742720 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5013,"thread_start_us":148,"threads_started":1}
I20260812 02:44:16.744359 32376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:16.727030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:41797 (local address 127.0.0.1:35244)
0812 02:44:16.730925 (+ 3895us) negotiation.cc:107] Waiting for socket to connect
0812 02:44:16.730938 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:44:16.731020 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:44:16.732579 (+ 1559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:44:16.732586 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:44:16.732613 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:44:16.732752 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:44:16.732760 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.734560 (+ 1800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.734564 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:44:16.739281 (+ 4717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:44:16.739291 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.743951 (+ 4660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.743957 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:44:16.744048 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:44:16.744083 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 02:44:16.744161 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 02:44:16.744232 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3829,"thread_start_us":101,"threads_started":1}
I20260812 02:44:16.745349 32377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:16.727439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35244 (local address 127.10.75.66:41797)
0812 02:44:16.731274 (+ 3835us) server_negotiation.cc:206] Beginning negotiation
0812 02:44:16.731281 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:44:16.731304 (+ 23us) server_negotiation.cc:407] Connection header received
0812 02:44:16.731375 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:44:16.731380 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:44:16.731544 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:44:16.731679 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:44:16.733270 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.734420 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.739545 (+ 5125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.743643 (+ 4098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.743752 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:44:16.743881 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 02:44:16.745101 (+ 1220us) server_negotiation.cc:299] Negotiation successful
0812 02:44:16.745210 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3728,"thread_start_us":105,"threads_started":1}
I20260812 02:44:16.746670 32378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:16.728209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:34185 (local address 127.0.0.1:37046)
0812 02:44:16.733815 (+ 5606us) negotiation.cc:107] Waiting for socket to connect
0812 02:44:16.733828 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:44:16.733917 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:44:16.734760 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:44:16.734763 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:44:16.734779 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:44:16.734871 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:44:16.734877 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.740584 (+ 5707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.740588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:44:16.741717 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:44:16.741729 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.746270 (+ 4541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.746274 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:44:16.746371 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:44:16.746398 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 02:44:16.746453 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 02:44:16.746524 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5543,"thread_start_us":168,"threads_started":1}
I20260812 02:44:16.747540 32374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:16.725330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48460 (local address 127.10.75.65:37399)
0812 02:44:16.730190 (+ 4860us) server_negotiation.cc:206] Beginning negotiation
0812 02:44:16.730198 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 02:44:16.730222 (+ 24us) server_negotiation.cc:407] Connection header received
0812 02:44:16.730298 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:44:16.730304 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:44:16.730527 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:44:16.730680 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:44:16.736426 (+ 5746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.737515 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.740099 (+ 2584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.741805 (+ 1706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.741909 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:44:16.745596 (+ 3687us) server_negotiation.cc:1035] Waiting for connection context
0812 02:44:16.745663 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 02:44:16.745770 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4747,"thread_start_us":122,"threads_started":1}
I20260812 02:44:16.749801 31987 tablet_service.cc:1467] Processing CreateTablet for tablet cb08c009dc5d4067b37c18ea4753ba37 (DEFAULT_TABLE table=test-table [id=b58a0361ba1140b5bce5542b8422d22e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:44:16.750348 31727 tablet_service.cc:1467] Processing CreateTablet for tablet cb08c009dc5d4067b37c18ea4753ba37 (DEFAULT_TABLE table=test-table [id=b58a0361ba1140b5bce5542b8422d22e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:44:16.751013 31987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb08c009dc5d4067b37c18ea4753ba37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:44:16.751291 31727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb08c009dc5d4067b37c18ea4753ba37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:44:16.759567 32379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:16.728403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37046 (local address 127.10.75.67:34185)
0812 02:44:16.734190 (+ 5787us) server_negotiation.cc:206] Beginning negotiation
0812 02:44:16.734201 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 02:44:16.734221 (+ 20us) server_negotiation.cc:407] Connection header received
0812 02:44:16.734289 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:44:16.734293 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:44:16.734461 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:44:16.734617 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:44:16.737484 (+ 2867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.738708 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.741903 (+ 3195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:16.742691 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:16.747088 (+ 4397us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:44:16.747223 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 02:44:16.747273 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 02:44:16.747363 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5685,"thread_start_us":92,"threads_started":1}
I20260812 02:44:16.762614 32224 tablet_service.cc:1467] Processing CreateTablet for tablet cb08c009dc5d4067b37c18ea4753ba37 (DEFAULT_TABLE table=test-table [id=b58a0361ba1140b5bce5542b8422d22e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:44:16.763661 32224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb08c009dc5d4067b37c18ea4753ba37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:44:16.766458 32381 tablet_bootstrap.cc:492] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f: Bootstrap starting.
I20260812 02:44:16.768970 32381 tablet_bootstrap.cc:654] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f: Neither blocks nor log segments found. Creating new log.
I20260812 02:44:16.773093 32381 log.cc:824] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f: Log is configured to *not* fsync() on all Append() calls
I20260812 02:44:16.778491 32382 tablet_bootstrap.cc:492] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650: Bootstrap starting.
I20260812 02:44:16.781121 32382 tablet_bootstrap.cc:654] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650: Neither blocks nor log segments found. Creating new log.
I20260812 02:44:16.782115 32382 log.cc:824] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650: Log is configured to *not* fsync() on all Append() calls
I20260812 02:44:16.782419 32388 tablet_bootstrap.cc:492] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e: Bootstrap starting.
I20260812 02:44:16.784977 32388 tablet_bootstrap.cc:654] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e: Neither blocks nor log segments found. Creating new log.
I20260812 02:44:16.785763 32388 log.cc:824] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e: Log is configured to *not* fsync() on all Append() calls
I20260812 02:44:16.787036 32382 tablet_bootstrap.cc:492] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650: No bootstrap required, opened a new log
I20260812 02:44:16.787232 32382 ts_tablet_manager.cc:1397] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260812 02:44:16.787979 32381 tablet_bootstrap.cc:492] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f: No bootstrap required, opened a new log
I20260812 02:44:16.788158 32381 ts_tablet_manager.cc:1397] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.000s
I20260812 02:44:16.792212 32382 raft_consensus.cc:348] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05baf6a2b10d41738038ddf12577826f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37399 } } peers { permanent_uuid: "8a0413d823744805bcb65d0a3c2b0650" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41797 } } peers { permanent_uuid: "e7b1c893fa2f4298a4c1df2065a4974e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34185 } }
I20260812 02:44:16.792448 32381 raft_consensus.cc:348] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05baf6a2b10d41738038ddf12577826f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37399 } } peers { permanent_uuid: "8a0413d823744805bcb65d0a3c2b0650" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41797 } } peers { permanent_uuid: "e7b1c893fa2f4298a4c1df2065a4974e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34185 } }
I20260812 02:44:16.792773 32381 raft_consensus.cc:374] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:44:16.792858 32381 raft_consensus.cc:729] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05baf6a2b10d41738038ddf12577826f, State: Initialized, Role: FOLLOWER
I20260812 02:44:16.793409 32381 consensus_queue.cc:260] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05baf6a2b10d41738038ddf12577826f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37399 } } peers { permanent_uuid: "8a0413d823744805bcb65d0a3c2b0650" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41797 } } peers { permanent_uuid: "e7b1c893fa2f4298a4c1df2065a4974e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34185 } }
I20260812 02:44:16.794618 32381 ts_tablet_manager.cc:1428] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f: Time spent starting tablet: real 0.006s user 0.000s sys 0.007s
I20260812 02:44:16.795006 31847 heartbeater.cc:503] Master 127.10.75.126:39899 was elected leader, sending a full tablet report...
I20260812 02:44:16.800153 32388 tablet_bootstrap.cc:492] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e: No bootstrap required, opened a new log
I20260812 02:44:16.800397 32388 ts_tablet_manager.cc:1397] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20260812 02:44:16.802143 32382 raft_consensus.cc:374] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:44:16.802306 32382 raft_consensus.cc:729] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a0413d823744805bcb65d0a3c2b0650, State: Initialized, Role: FOLLOWER
I20260812 02:44:16.802942 32382 consensus_queue.cc:260] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05baf6a2b10d41738038ddf12577826f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37399 } } peers { permanent_uuid: "8a0413d823744805bcb65d0a3c2b0650" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41797 } } peers { permanent_uuid: "e7b1c893fa2f4298a4c1df2065a4974e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34185 } }
I20260812 02:44:16.804234 32382 ts_tablet_manager.cc:1428] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650: Time spent starting tablet: real 0.017s user 0.007s sys 0.000s
I20260812 02:44:16.804468 32388 raft_consensus.cc:348] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05baf6a2b10d41738038ddf12577826f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37399 } } peers { permanent_uuid: "8a0413d823744805bcb65d0a3c2b0650" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41797 } } peers { permanent_uuid: "e7b1c893fa2f4298a4c1df2065a4974e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34185 } }
I20260812 02:44:16.804704 32105 heartbeater.cc:503] Master 127.10.75.126:39899 was elected leader, sending a full tablet report...
I20260812 02:44:16.804785 32388 raft_consensus.cc:374] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:44:16.804850 32388 raft_consensus.cc:729] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7b1c893fa2f4298a4c1df2065a4974e, State: Initialized, Role: FOLLOWER
I20260812 02:44:16.805338 32388 consensus_queue.cc:260] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05baf6a2b10d41738038ddf12577826f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37399 } } peers { permanent_uuid: "8a0413d823744805bcb65d0a3c2b0650" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41797 } } peers { permanent_uuid: "e7b1c893fa2f4298a4c1df2065a4974e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34185 } }
I20260812 02:44:16.806422 32388 ts_tablet_manager.cc:1428] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 02:44:16.806763 32349 heartbeater.cc:503] Master 127.10.75.126:39899 was elected leader, sending a full tablet report...
W20260812 02:44:16.848625 31848 tablet.cc:2369] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 02:44:16.850689 32351 tablet.cc:2369] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 02:44:16 dist-test-slave-2p8l krb5kdc[30579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502655, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
W20260812 02:44:16.928838 32107 tablet.cc:2369] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:44:17.040392 32394 raft_consensus.cc:482] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:44:17.040679 32394 raft_consensus.cc:504] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05baf6a2b10d41738038ddf12577826f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37399 } } peers { permanent_uuid: "8a0413d823744805bcb65d0a3c2b0650" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41797 } } peers { permanent_uuid: "e7b1c893fa2f4298a4c1df2065a4974e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34185 } }
I20260812 02:44:17.042199 32394 leader_election.cc:288] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a0413d823744805bcb65d0a3c2b0650 (127.10.75.66:41797), e7b1c893fa2f4298a4c1df2065a4974e (127.10.75.67:34185)
I20260812 02:44:17.048563 32377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:17.043555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:43759 (local address 127.10.75.66:41797)
0812 02:44:17.043718 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 02:44:17.043723 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:44:17.044065 (+ 342us) server_negotiation.cc:407] Connection header received
0812 02:44:17.044315 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:44:17.044319 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:44:17.044370 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:44:17.044421 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:44:17.044858 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:17.045646 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:17.047249 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:17.047824 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:17.047918 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:44:17.047970 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 02:44:17.048331 (+ 361us) server_negotiation.cc:299] Negotiation successful
0812 02:44:17.048428 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 02:44:17.049172 32406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:17.042607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:41797 (local address 127.10.75.65:43759)
0812 02:44:17.043962 (+ 1355us) negotiation.cc:107] Waiting for socket to connect
0812 02:44:17.043979 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:44:17.044172 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:44:17.044597 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:44:17.044600 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:44:17.044620 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:44:17.044723 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:44:17.044729 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:44:17.045803 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:44:17.045805 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:44:17.047108 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:44:17.047119 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:44:17.048067 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:44:17.048070 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:44:17.048184 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:44:17.048206 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 02:44:17.048933 (+ 727us) client_negotiation.cc:240] Negotiation successful
0812 02:44:17.049007 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1277,"thread_start_us":127,"threads_started":1}
I20260812 02:44:17.050506 31994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb08c009dc5d4067b37c18ea4753ba37" candidate_uuid: "05baf6a2b10d41738038ddf12577826f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0413d823744805bcb65d0a3c2b0650" is_pre_election: true
I20260812 02:44:17.051424 31994 raft_consensus.cc:2454] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05baf6a2b10d41738038ddf12577826f in term 0.
I20260812 02:44:17.052597 31646 leader_election.cc:302] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05baf6a2b10d41738038ddf12577826f, 8a0413d823744805bcb65d0a3c2b0650; no voters:
I20260812 02:44:17.053050 32394 raft_consensus.cc:2781] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:44:17.053190 32394 raft_consensus.cc:482] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:44:17.053236 32394 raft_consensus.cc:3037] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:44:17.055163 32394 raft_consensus.cc:504] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05baf6a2b10d41738038ddf12577826f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37399 } } peers { permanent_uuid: "8a0413d823744805bcb65d0a3c2b0650" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41797 } } peers { permanent_uuid: "e7b1c893fa2f4298a4c1df2065a4974e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34185 } }
I20260812 02:44:17.055562 32394 leader_election.cc:288] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f [CANDIDATE]: Term 1 election: Requested vote from peers 8a0413d823744805bcb65d0a3c2b0650 (127.10.75.66:41797), e7b1c893fa2f4298a4c1df2065a4974e (127.10.75.67:34185)
I20260812 02:44:17.056023 31994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb08c009dc5d4067b37c18ea4753ba37" candidate_uuid: "05baf6a2b10d41738038ddf12577826f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0413d823744805bcb65d0a3c2b0650"
I20260812 02:44:17.056154 31994 raft_consensus.cc:3037] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:44:17.057541 31994 raft_consensus.cc:2454] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05baf6a2b10d41738038ddf12577826f in term 1.
I20260812 02:44:17.057983 31646 leader_election.cc:302] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05baf6a2b10d41738038ddf12577826f, 8a0413d823744805bcb65d0a3c2b0650; no voters:
I20260812 02:44:17.058240 32394 raft_consensus.cc:2781] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:44:17.058447 32394 raft_consensus.cc:686] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f [term 1 LEADER]: Becoming Leader. State: Replica: 05baf6a2b10d41738038ddf12577826f, State: Running, Role: LEADER
I20260812 02:44:17.058820 32394 consensus_queue.cc:237] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05baf6a2b10d41738038ddf12577826f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37399 } } peers { permanent_uuid: "8a0413d823744805bcb65d0a3c2b0650" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41797 } } peers { permanent_uuid: "e7b1c893fa2f4298a4c1df2065a4974e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34185 } }
I20260812 02:44:17.062376 31467 catalog_manager.cc:5495] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f reported cstate change: term changed from 0 to 1, leader changed from <none> to 05baf6a2b10d41738038ddf12577826f (127.10.75.65). New cstate: current_term: 1 leader_uuid: "05baf6a2b10d41738038ddf12577826f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05baf6a2b10d41738038ddf12577826f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 37399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a0413d823744805bcb65d0a3c2b0650" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7b1c893fa2f4298a4c1df2065a4974e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260812 02:44:17.065580 32379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:17.043727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:46277 (local address 127.10.75.67:34185)
0812 02:44:17.043859 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 02:44:17.043864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:44:17.045548 (+ 1684us) server_negotiation.cc:407] Connection header received
0812 02:44:17.045753 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:44:17.045757 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:44:17.045803 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:44:17.045854 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:44:17.046525 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:17.051991 (+ 5466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:17.063966 (+ 11975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:17.064734 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:17.064856 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:44:17.064929 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 02:44:17.065365 (+ 436us) server_negotiation.cc:299] Negotiation successful
0812 02:44:17.065456 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 02:44:17.066002 32408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:17.043064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:34185 (local address 127.10.75.65:46277)
0812 02:44:17.045437 (+ 2373us) negotiation.cc:107] Waiting for socket to connect
0812 02:44:17.045453 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:44:17.045623 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:44:17.046251 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:44:17.046254 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:44:17.046273 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:44:17.046383 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:44:17.046389 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:44:17.062422 (+ 16033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:44:17.062425 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:44:17.063761 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:44:17.063776 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:44:17.065053 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:44:17.065057 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:44:17.065191 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:44:17.065224 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 02:44:17.065783 (+ 559us) client_negotiation.cc:240] Negotiation successful
0812 02:44:17.065862 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2305,"thread_start_us":105,"threads_started":1}
I20260812 02:44:17.066987 32247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb08c009dc5d4067b37c18ea4753ba37" candidate_uuid: "05baf6a2b10d41738038ddf12577826f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7b1c893fa2f4298a4c1df2065a4974e" is_pre_election: true
I20260812 02:44:17.067277 32247 raft_consensus.cc:2454] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05baf6a2b10d41738038ddf12577826f in term 0.
I20260812 02:44:17.066992 32243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb08c009dc5d4067b37c18ea4753ba37" candidate_uuid: "05baf6a2b10d41738038ddf12577826f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7b1c893fa2f4298a4c1df2065a4974e"
I20260812 02:44:17.067562 32243 raft_consensus.cc:3037] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:44:17.068836 32243 raft_consensus.cc:2454] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05baf6a2b10d41738038ddf12577826f in term 1.
I20260812 02:44:17.097875 32374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:17.092825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48476 (local address 127.10.75.65:37399)
0812 02:44:17.092957 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 02:44:17.092962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:44:17.092976 (+ 14us) server_negotiation.cc:407] Connection header received
0812 02:44:17.093078 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:44:17.093083 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:44:17.093149 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:44:17.093252 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:44:17.093643 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:17.094442 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:17.095717 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:44:17.096058 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:44:17.096162 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:44:17.096589 (+ 427us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:44:17.097130 (+ 541us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:44:17.097249 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 02:44:17.097655 (+ 406us) server_negotiation.cc:299] Negotiation successful
0812 02:44:17.097713 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 02:44:17.104470 31994 raft_consensus.cc:1261] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650 [term 1 FOLLOWER]: Refusing update from remote peer 05baf6a2b10d41738038ddf12577826f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:44:17.104470 32243 raft_consensus.cc:1261] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e [term 1 FOLLOWER]: Refusing update from remote peer 05baf6a2b10d41738038ddf12577826f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:44:17.105249 32394 consensus_queue.cc:1035] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7b1c893fa2f4298a4c1df2065a4974e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:44:17.105693 32394 consensus_queue.cc:1035] T cb08c009dc5d4067b37c18ea4753ba37 P 05baf6a2b10d41738038ddf12577826f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a0413d823744805bcb65d0a3c2b0650" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:44:17.113565 32418 mvcc.cc:205] Tried to move back new op lower bound from 7317514883492306944 to 7317514883316588544. Current Snapshot: MvccSnapshot[applied={T|T < 7317514883492306944}]
I20260812 02:44:17.113907 32414 mvcc.cc:205] Tried to move back new op lower bound from 7317514883492306944 to 7317514883316588544. Current Snapshot: MvccSnapshot[applied={T|T < 7317514883492306944}]
I20260812 02:44:17.115227 32421 mvcc.cc:205] Tried to move back new op lower bound from 7317514883492306944 to 7317514883316588544. Current Snapshot: MvccSnapshot[applied={T|T < 7317514883492306944}]
I20260812 02:44:17.124331 31466 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51922:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:44:17.124526 31466 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51922:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:44:17.127400 31466 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6757a8f339964971af0434fbe4f0f40a: Sending DeleteTablet for 3 replicas of tablet cb08c009dc5d4067b37c18ea4753ba37
I20260812 02:44:17.128419 32224 tablet_service.cc:1514] Processing DeleteTablet for tablet cb08c009dc5d4067b37c18ea4753ba37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:44:17 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:37046
I20260812 02:44:17.128530 31727 tablet_service.cc:1514] Processing DeleteTablet for tablet cb08c009dc5d4067b37c18ea4753ba37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:44:17 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:48460
I20260812 02:44:17.128924 32443 tablet_replica.cc:330] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e: stopping tablet replica
I20260812 02:44:17.129125 31987 tablet_service.cc:1514] Processing DeleteTablet for tablet cb08c009dc5d4067b37c18ea4753ba37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:44:17 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:35244
I20260812 02:44:17.129962 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 31613
I20260812 02:44:17.133876 32443 raft_consensus.cc:2229] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:44:17.134218 32443 raft_consensus.cc:2258] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:44:17.134603 32452 tablet_replica.cc:330] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650: stopping tablet replica
I20260812 02:44:17.134887 32452 raft_consensus.cc:2229] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:44:17.135181 32452 raft_consensus.cc:2258] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:44:17.135890 32443 ts_tablet_manager.cc:1905] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:44:17.136631 32452 ts_tablet_manager.cc:1905] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:44:17.138532 32443 ts_tablet_manager.cc:1918] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:44:17.138636 32443 log.cc:1196] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/cb08c009dc5d4067b37c18ea4753ba37
I20260812 02:44:17.138940 32443 ts_tablet_manager.cc:1939] T cb08c009dc5d4067b37c18ea4753ba37 P e7b1c893fa2f4298a4c1df2065a4974e: Deleting consensus metadata
I20260812 02:44:17.139941 32452 ts_tablet_manager.cc:1918] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:44:17.140053 32452 log.cc:1196] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/cb08c009dc5d4067b37c18ea4753ba37
I20260812 02:44:17.140131 31442 catalog_manager.cc:4841] TS e7b1c893fa2f4298a4c1df2065a4974e (127.10.75.67:34185): tablet cb08c009dc5d4067b37c18ea4753ba37 (table test-table [id=b58a0361ba1140b5bce5542b8422d22e]) successfully deleted
I20260812 02:44:17.140378 32452 ts_tablet_manager.cc:1939] T cb08c009dc5d4067b37c18ea4753ba37 P 8a0413d823744805bcb65d0a3c2b0650: Deleting consensus metadata
I20260812 02:44:17.141599 31441 catalog_manager.cc:4841] TS 8a0413d823744805bcb65d0a3c2b0650 (127.10.75.66:41797): tablet cb08c009dc5d4067b37c18ea4753ba37 (table test-table [id=b58a0361ba1140b5bce5542b8422d22e]) successfully deleted
W20260812 02:44:17.142386 31442 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.75.65:37399 (error 108)
I20260812 02:44:17.143281 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 31857
I20260812 02:44:17.143472 32378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:44:17.143144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:37399 (local address 127.0.0.1:48484)
0812 02:44:17.143279 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 02:44:17.143360 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.65:37399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 02:44:17.169937 31442 catalog_manager.cc:4584] TS 05baf6a2b10d41738038ddf12577826f (127.10.75.65:37399): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cb08c009dc5d4067b37c18ea4753ba37: Network error: Client connection negotiation failed: client connection to 127.10.75.65:37399: connect: Connection refused (error 111)
I20260812 02:44:17.176112 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 32113
I20260812 02:44:17.191790 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 31404
I20260812 02:44:17.204185 10541 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 02:44:17.551724 10541 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 02:44:17.551852 10541 mini_ranger.cc:66] Stopping Ranger...
I20260812 02:44:17.896584 10541 mini_ranger.cc:68] Stopped Ranger
2026-08-12 02:44:17.896 UTC [30637] LOG: received smart shutdown request
2026-08-12 02:44:17.900 UTC [30637] LOG: background worker "logical replication launcher" (PID 30654) exited with exit code 1
2026-08-12 02:44:17.901 UTC [30648] LOG: shutting down
2026-08-12 02:44:18.081 UTC [30637] LOG: database system is shut down
2026-08-12T02:44:18Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (49009 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:44:18 dist-test-slave-2p8l krb5kdc[32472](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:44:18 dist-test-slave-2p8l krb5kdc[32472](info): set up 2 sockets
Aug 12 02:44:18 dist-test-slave-2p8l krb5kdc[32472](info): commencing operation
krb5kdc: starting...
W20260812 02:44:19.538329 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.311s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:44:19 dist-test-slave-2p8l krb5kdc[32472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502659, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:44:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:44:19Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.10.75.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.10.75.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.10.75.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/rangeradmin_127.10.75.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.10.75.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/rangeradmin_127.10.75.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.10.75.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.10.75.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.10.75.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/rangerlookup_127.10.75.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.10.75.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/rangerlookup_127.10.75.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.75.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.10.75.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.75.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/HTTP_127.10.75.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.75.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/HTTP_127.10.75.84@KRBTEST.COM.keytab.
I20260812 02:44:19.717615 10541 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskWpp1yo/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/postgres -l logfile start
2026-08-12 02:44:22.193 UTC [32540] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 02:44:22.194 UTC [32540] LOG: listening on IPv4 address "127.10.75.84", port 59913
2026-08-12 02:44:22.197 UTC [32540] LOG: listening on Unix socket "/tmp/.s.PGSQL.59913"
2026-08-12 02:44:22.221 UTC [32553] LOG: database system was shut down at 2026-08-12 02:44:20 UTC
2026-08-12 02:44:22.226 UTC [32540] LOG: database system is ready to accept connections
I20260812 02:44:23.495626 10541 mini_postgres.cc:96] Postgres bound to 59913
2026-08-12 02:44:23.504 UTC [32569] FATAL: database "slave" does not exist
127.10.75.84:59913 - accepting connections
I20260812 02:44:23.504668 10541 mini_ranger.cc:161] Starting Ranger...
I20260812 02:44:23.520967 10541 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 02:44:23.999141 10541 mini_ranger.cc:87] Created ranger Postgres database
I20260812 02:44:23.999235 10541 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ranger-admin
2026-08-12 02:44:24,287 [I] DB FLAVOR :POSTGRES
2026-08-12 02:44:24,288 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 02:44:24,288 [I] Checking connection..
2026-08-12 02:44:24,288 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 02:44:24,560 [I] Checking connection passed.
2026-08-12 02:44:24,560 [I] --------- Verifying version history table ---------
2026-08-12 02:44:24,560 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 02:44:24,829 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 02:44:24,829 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 02:44:25,099 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 02:44:25,099 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 02:44:25,099 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 02:44:25.339 UTC [32686] WARNING: there is no transaction in progress
2026-08-12 02:44:25,349 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 02:44:25,350 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 02:44:25,615 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 02:44:25,615 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 02:44:25,615 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 02:44:25,873 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 02:44:26,142 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-2p8l.c.gcp-upstream.internal','N') ;"
2026-08-12 02:44:26,371 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 02:44:26,642 [I] Table x_portal_user does not exist in database ranger
2026-08-12 02:44:26,642 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 02:44:26,903 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 02:44:26,904 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 02:44:27,167 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 02:44:27,413 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 02:44:27,414 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 02:44:28.367 UTC [412] WARNING: there is no transaction in progress
2026-08-12 02:44:28.383 UTC [412] WARNING: there is no transaction in progress
2026-08-12 02:44:28.399 UTC [412] WARNING: there is no transaction in progress
2026-08-12 02:44:28.414 UTC [412] WARNING: there is no transaction in progress
2026-08-12 02:44:28.429 UTC [412] WARNING: there is no transaction in progress
2026-08-12 02:44:28.446 UTC [412] WARNING: there is no transaction in progress
2026-08-12 02:44:28.498 UTC [412] WARNING: there is no transaction in progress
2026-08-12 02:44:28.505 UTC [412] WARNING: there is no transaction in progress
2026-08-12 02:44:28.520 UTC [412] WARNING: there is no transaction in progress
2026-08-12 02:44:28.530 UTC [412] WARNING: there is no transaction in progress
2026-08-12 02:44:28.540 UTC [412] WARNING: there is no transaction in progress
2026-08-12 02:44:28.552 UTC [412] WARNING: there is no transaction in progress
2026-08-12 02:44:28.561 UTC [412] WARNING: there is no transaction in progress
2026-08-12 02:44:28.568 UTC [412] WARNING: there is no transaction in progress
2026-08-12 02:44:28.575 UTC [412] WARNING: there is no transaction in progress
2026-08-12 02:44:28.583 UTC [412] WARNING: there is no transaction in progress
2026-08-12 02:44:29,292 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 02:44:29,292 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 02:44:29,597 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 02:44:29,598 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 02:44:29,868 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 02:44:29,868 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 02:44:30,131 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 02:44:30,131 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 02:44:30,374 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 02:44:30,637 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-2p8l.c.gcp-upstream.internal';"
2026-08-12 02:44:30,901 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 02:44:30,902 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 02:44:31,168 [I] DB_PATCHES have already been applied
I20260812 02:44:31.174230 10541 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ranger-admin:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskWpp1yo/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 02:44:31.174311 10541 mini_ranger.cc:193] Using host: 127.10.75.84
I20260812 02:44:31.179260 10541 mini_ranger.cc:227] Ranger admin URL: http://127.10.75.84:58501
Aug 12, 2026 2:44:31 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 2:44:31 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 2:44:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 2:44:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 2:44:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 2:44:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 2:44:32 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 02:44:32.687507 10541 mini_ranger.cc:160] Time spent starting Ranger: real 9.183s user 0.000s sys 0.013s
Aug 12, 2026 2:44:52 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 2:44:52 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 12, 2026 2:44:52 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 2:44:52 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 2:44:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 2:44:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 2:44:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 2:44:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 2:44:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 2:44:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 2:44:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 2:44:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 2:44:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 2:44:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 2:44:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 2:44:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 2:44:52 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 2:44:53 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 02:44:54.517285 10541 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.10.75.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.10.75.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.10.75.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/rangerkms_127.10.75.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.10.75.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/rangerkms_127.10.75.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.75.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.10.75.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.75.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/HTTP_127.10.75.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.75.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/HTTP_127.10.75.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 02:44:54 dist-test-slave-2p8l krb5kdc[32472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502694, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 02:44:54.623334 10541 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 02:44:54.636047 10541 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 02:44:55.478736 10541 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 02:44:55.478818 10541 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ranger-kms
I20260812 02:44:55.478832 10541 mini_ranger_kms.cc:227] Using postgres at 127.10.75.84:59913
2026-08-12 02:44:55,670 [I] DB FLAVOR :POSTGRES
2026-08-12 02:44:55,670 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 02:44:55,670 [I] Checking connection
2026-08-12 02:44:55,670 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 02:44:55,912 [I] connection success
2026-08-12 02:44:55,912 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 02:44:55,913 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 02:44:55,913 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 02:44:56,180 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 02:44:56,181 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 02:44:56,181 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 02:44:56,181 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.75.84:59913/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 02:44:56,471 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 02:44:56.983633 10541 mini_ranger_kms.cc:310] Created kms service
I20260812 02:44:57.207902 10541 mini_ranger_kms.cc:326] Created kudu user
I20260812 02:44:57.255504 10541 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 02:44:57 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502694, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
I20260812 02:44:57.641860 10541 mini_ranger_kms.cc:384] Added ranger policy
I20260812 02:44:57.642089 10541 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ranger-kms:/tmp/dist-test-taskWpp1yo/build/debug/bin/postgresql.jar:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskWpp1yo/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 02:44:57.642123 10541 mini_ranger_kms.cc:240] Using host: 127.10.75.84
I20260812 02:44:57.647177 10541 mini_ranger_kms.cc:276] Ranger KMS PID: 743
I20260812 02:44:57.647264 10541 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.10.75.84:35509
Aug 12, 2026 2:44:58 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 2:44:58 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 2:44:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 2:44:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 2:44:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 2:44:59 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 02:44:59 dist-test-slave-2p8l krb5kdc[32472](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786502699, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.75.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 12 02:45:00 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502699, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.75.84@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
I20260812 02:45:00.589357 10541 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.966s user 0.006s sys 0.170s
I20260812 02:45:00.589490 10541 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 02:45:00.589583 10541 mini_ranger_kms.cc:401] 127.10.75.84:35509/kms/v1/keys
Aug 12 02:45:00 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502699, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.75.84@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
Aug 12 02:45:02 dist-test-slave-2p8l krb5kdc[32472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:45:02.993621 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:43039
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:40573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:43039
--ranger_config_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.75.84:35509/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:45:03.115738 835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:03.115996 835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:03.116035 835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:03.120117 835 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:45:03.120174 835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:03.120193 835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:03.120209 835 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:45:03.120225 835 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:45:03.125700 835 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:40573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/wal
--ranger_kms_url=127.10.75.84:35509/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:43039
--ranger_config_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:43039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:03.126814 835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:03.127868 835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:03.137012 852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:03.137019 848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:03.137066 835 server_base.cc:1034] running on GCE node
W20260812 02:45:03.137032 850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:03.137815 835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:03.139014 835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:03.140197 835 hybrid_clock.cc:648] HybridClock initialized: now 1786502703140168 us; error 31 us; skew 500 ppm
Aug 12 02:45:03 dist-test-slave-2p8l krb5kdc[32472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502703, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:03.143203 835 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:45:03.144032 835 webserver.cc:460] Webserver started at http://127.10.75.126:44391/ using document root <none> and password file <none>
I20260812 02:45:03.144554 835 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:03.144645 835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:03.144820 835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 02:45:03 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502703, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
I20260812 02:45:03.200047 835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "2503915edd684ea885700aaea8837698"
format_stamp: "Formatted at 2026-08-12 02:45:03 on dist-test-slave-2p8l"
server_key: "c1ddb150b27c7b9fdbd6fbf34ce606d4"
server_key_iv: "a647ceaa718919b8bc29e20ea541f902"
server_key_version: "kuduclusterkey@0"
I20260812 02:45:03.200727 835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "2503915edd684ea885700aaea8837698"
format_stamp: "Formatted at 2026-08-12 02:45:03 on dist-test-slave-2p8l"
server_key: "c1ddb150b27c7b9fdbd6fbf34ce606d4"
server_key_iv: "a647ceaa718919b8bc29e20ea541f902"
server_key_version: "kuduclusterkey@0"
I20260812 02:45:03.205089 835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260812 02:45:03.223613 867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:03.225183 835 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 02:45:03.225339 835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "2503915edd684ea885700aaea8837698"
format_stamp: "Formatted at 2026-08-12 02:45:03 on dist-test-slave-2p8l"
server_key: "c1ddb150b27c7b9fdbd6fbf34ce606d4"
server_key_iv: "a647ceaa718919b8bc29e20ea541f902"
server_key_version: "kuduclusterkey@0"
I20260812 02:45:03.225476 835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:03.241338 835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:03.244484 835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:03.244724 835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:03.252768 835 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:43039
I20260812 02:45:03.252852 975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:43039 every 8 connection(s)
I20260812 02:45:03.253758 835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:45:03.256646 978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:03.262233 978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698: Bootstrap starting.
I20260812 02:45:03.262341 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 835
I20260812 02:45:03.262459 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:45:03.262768 10541 external_mini_cluster.cc:1428] Setting key ebf79b7a985651b5f1fcd1d966cc2cfe
I20260812 02:45:03.264974 978 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:03.265723 978 log.cc:824] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:03.267998 978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698: No bootstrap required, opened a new log
I20260812 02:45:03.272339 978 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2503915edd684ea885700aaea8837698" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43039 } }
I20260812 02:45:03.272639 978 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
Aug 12 02:45:03 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:03.272710 978 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2503915edd684ea885700aaea8837698, State: Initialized, Role: FOLLOWER
I20260812 02:45:03.273284 978 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2503915edd684ea885700aaea8837698" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43039 } }
I20260812 02:45:03.273479 978 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:45:03.273566 978 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:45:03.273692 978 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:03.274706 978 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2503915edd684ea885700aaea8837698" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43039 } }
I20260812 02:45:03.275075 978 leader_election.cc:302] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2503915edd684ea885700aaea8837698; no voters:
I20260812 02:45:03.275476 978 leader_election.cc:288] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:45:03.275604 985 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:45:03.275853 985 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [term 1 LEADER]: Becoming Leader. State: Replica: 2503915edd684ea885700aaea8837698, State: Running, Role: LEADER
I20260812 02:45:03.276182 985 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2503915edd684ea885700aaea8837698" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43039 } }
I20260812 02:45:03.276877 978 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:45:03.277972 986 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2503915edd684ea885700aaea8837698" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2503915edd684ea885700aaea8837698" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43039 } } }
I20260812 02:45:03.278122 986 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [sys.catalog]: This master's current role is: LEADER
I20260812 02:45:03.278510 1002 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:45:03.279142 983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:03.264255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32852 (local address 127.10.75.126:43039)
0812 02:45:03.264749 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:03.264766 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:03.264803 (+ 37us) server_negotiation.cc:407] Connection header received
0812 02:45:03.265528 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:03.265547 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:03.265935 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:03.266335 (+ 400us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:03.267071 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:03.268634 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:03.269530 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:03.270349 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:03.270561 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:03.273261 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:03.273268 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:03.273284 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:03.273320 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:03.275347 (+ 2027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:03.275937 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:03.275943 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:03.275949 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:03.276088 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:03.276454 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:03.276458 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:03.276459 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:03.276994 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:03.277239 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:03.277715 (+ 476us) server_negotiation.cc:299] Negotiation successful
0812 02:45:03.278049 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":183,"threads_started":1}
I20260812 02:45:03.279227 987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2503915edd684ea885700aaea8837698. Latest consensus state: current_term: 1 leader_uuid: "2503915edd684ea885700aaea8837698" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2503915edd684ea885700aaea8837698" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43039 } } }
I20260812 02:45:03.279311 987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [sys.catalog]: This master's current role is: LEADER
I20260812 02:45:03.281618 1002 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:45:03.282258 978 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 02:45:03.292393 1002 catalog_manager.cc:1347] Generated new cluster ID: 527ef4b474fd4481b18dced02f83901a
I20260812 02:45:03.292492 1002 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:45:03.325740 1002 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:45:03.327224 1002 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:45:03.337096 1002 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698: Generated new TSK 0
I20260812 02:45:03.337934 1002 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
I20260812 02:45:04.013453 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.75.84:35509/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43039
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:40573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:45:04.134996 1062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:04.135258 1062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:04.135301 1062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:04.139559 1062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:04.139654 1062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:04.139760 1062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:45:04.145406 1062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:40573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.10.75.84:35509/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:04.146646 1062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:04.147675 1062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:04.157269 1078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:04.157375 1076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:04.157281 1074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:04.158281 1062 server_base.cc:1034] running on GCE node
I20260812 02:45:04.158897 1062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:04.159689 1062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:04.160887 1062 hybrid_clock.cc:648] HybridClock initialized: now 1786502704160854 us; error 48 us; skew 500 ppm
Aug 12 02:45:04 dist-test-slave-2p8l krb5kdc[32472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502704, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:04.164338 1062 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:45:04.165282 1062 webserver.cc:460] Webserver started at http://127.10.75.65:38015/ using document root <none> and password file <none>
I20260812 02:45:04.165845 1062 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:04.165907 1062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:04.166190 1062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 02:45:04 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502704, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
I20260812 02:45:04.182683 1062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "4e4e65965fbe4819bfff62e0792a8abd"
format_stamp: "Formatted at 2026-08-12 02:45:04 on dist-test-slave-2p8l"
server_key: "ed938a34cec0bd68fe99b5c0c138dfad"
server_key_iv: "8cf5c685c8cbac58fb9927d89c4f9700"
server_key_version: "kuduclusterkey@0"
I20260812 02:45:04.183610 1062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "4e4e65965fbe4819bfff62e0792a8abd"
format_stamp: "Formatted at 2026-08-12 02:45:04 on dist-test-slave-2p8l"
server_key: "ed938a34cec0bd68fe99b5c0c138dfad"
server_key_iv: "8cf5c685c8cbac58fb9927d89c4f9700"
server_key_version: "kuduclusterkey@0"
I20260812 02:45:04.193189 1062 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.004s sys 0.000s
I20260812 02:45:04.211303 1095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:04.213034 1062 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.001s sys 0.000s
I20260812 02:45:04.213164 1062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "4e4e65965fbe4819bfff62e0792a8abd"
format_stamp: "Formatted at 2026-08-12 02:45:04 on dist-test-slave-2p8l"
server_key: "ed938a34cec0bd68fe99b5c0c138dfad"
server_key_iv: "8cf5c685c8cbac58fb9927d89c4f9700"
server_key_version: "kuduclusterkey@0"
I20260812 02:45:04.213351 1062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:04.241158 1062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:04.245148 1062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:04.245417 1062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:04.246168 1062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:04.247337 1062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:45:04.247454 1062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:04.247610 1062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:45:04.247706 1062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:04.259027 1062 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:46067
I20260812 02:45:04.260304 1062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:45:04.263557 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 1062
I20260812 02:45:04.263679 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:45:04.263975 10541 external_mini_cluster.cc:1428] Setting key c7b9a01ee4ea9742d4b39feaeb12f587
I20260812 02:45:04.270756 1328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:46067 every 8 connection(s)
WARNING: no policy specified for kudu/127.10.75.66@KRBTEST.COM; defaulting to no policy
Aug 12 02:45:04 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502704, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.66@KRBTEST.COM" created.
I20260812 02:45:04.299553 1333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:04.273078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:43039 (local address 127.10.75.65:54023)
0812 02:45:04.274475 (+ 1397us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:04.274537 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:04.275768 (+ 1231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:04.276419 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:04.276431 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:04.276885 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:04.278490 (+ 1605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:04.278513 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:04.279772 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:04.279778 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:04.281318 (+ 1540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:04.281332 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:04.282230 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:04.282237 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:04.282435 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:04.284094 (+ 1659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:04.284117 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:04.287251 (+ 3134us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:04.295918 (+ 8667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:04.295928 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:04.295950 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:04.296359 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:04.296745 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:04.296750 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:04.296753 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:04.296958 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:04.297492 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:04.297500 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:04.297889 (+ 389us) client_negotiation.cc:769] Sending connection context
0812 02:45:04.298174 (+ 285us) client_negotiation.cc:240] Negotiation successful
0812 02:45:04.298550 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1149,"thread_start_us":160,"threads_started":1}
I20260812 02:45:04.300716 1336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:04.274258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:54023 (local address 127.10.75.126:43039)
0812 02:45:04.275620 (+ 1362us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:04.275629 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:04.275649 (+ 20us) server_negotiation.cc:407] Connection header received
0812 02:45:04.276030 (+ 381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:04.276033 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:04.276089 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:04.276199 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:04.278660 (+ 2461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:04.279601 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:04.281474 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:04.281866 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:04.281987 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:04.287491 (+ 5504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:04.287496 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:04.287499 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:04.287531 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:04.295739 (+ 8208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:04.296510 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:04.296513 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:04.296515 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:04.296622 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:04.297088 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:04.297093 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:04.297094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:04.297355 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:04.300257 (+ 2902us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:04.300325 (+ 68us) server_negotiation.cc:299] Negotiation successful
0812 02:45:04.300433 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1279,"thread_start_us":108,"threads_started":1}
I20260812 02:45:04.302117 1329 heartbeater.cc:347] Connected to a master server at 127.10.75.126:43039
I20260812 02:45:04.302320 1329 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:04.302927 1329 heartbeater.cc:511] Master 127.10.75.126:43039 requested a full tablet report, sending...
I20260812 02:45:04.304885 905 ts_manager.cc:194] Registered new tserver with Master: 4e4e65965fbe4819bfff62e0792a8abd (127.10.75.65:46067)
I20260812 02:45:04.306457 905 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:54023
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
I20260812 02:45:04.315585 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.75.84:35509/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43039
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:40573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 02:45:04 dist-test-slave-2p8l krb5kdc[32472](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786502704, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 02:45:04.458441 1341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:04.458812 1341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:04.458889 1341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:04.465646 1341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:04.465734 1341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:04.465829 1341 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:45:04.472348 1341 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:40573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.10.75.84:35509/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:04.473838 1341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:04.475327 1341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:04.488415 1354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:04.488533 1356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:04.488710 1341 server_base.cc:1034] running on GCE node
W20260812 02:45:04.488900 1352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:04.489652 1341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:04.490511 1341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:04.493856 1341 hybrid_clock.cc:648] HybridClock initialized: now 1786502704493779 us; error 86 us; skew 500 ppm
Aug 12 02:45:04 dist-test-slave-2p8l krb5kdc[32472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502704, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:04.497455 1341 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:45:04.498656 1341 webserver.cc:460] Webserver started at http://127.10.75.66:34341/ using document root <none> and password file <none>
I20260812 02:45:04.499322 1341 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:04.499431 1341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:04.499742 1341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 02:45:04 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502704, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
I20260812 02:45:04.517207 1341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "fa617a56ad5b4fada53cc18664d1fc43"
format_stamp: "Formatted at 2026-08-12 02:45:04 on dist-test-slave-2p8l"
server_key: "a82b26fd492387a8859773cd8fab22de"
server_key_iv: "9175356efb8d62005de7767441536c03"
server_key_version: "kuduclusterkey@0"
I20260812 02:45:04.518158 1341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "fa617a56ad5b4fada53cc18664d1fc43"
format_stamp: "Formatted at 2026-08-12 02:45:04 on dist-test-slave-2p8l"
server_key: "a82b26fd492387a8859773cd8fab22de"
server_key_iv: "9175356efb8d62005de7767441536c03"
server_key_version: "kuduclusterkey@0"
I20260812 02:45:04.524120 1341 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 02:45:04.546283 1369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:04.548213 1341 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260812 02:45:04.548378 1341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "fa617a56ad5b4fada53cc18664d1fc43"
format_stamp: "Formatted at 2026-08-12 02:45:04 on dist-test-slave-2p8l"
server_key: "a82b26fd492387a8859773cd8fab22de"
server_key_iv: "9175356efb8d62005de7767441536c03"
server_key_version: "kuduclusterkey@0"
I20260812 02:45:04.548537 1341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:04.582463 1341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:04.586747 1341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:04.587041 1341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:04.587847 1341 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:04.589030 1341 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:45:04.589156 1341 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:04.589268 1341 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:45:04.589341 1341 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:04.604214 1341 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:45119
I20260812 02:45:04.605666 1341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:45:04.616165 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 1341
I20260812 02:45:04.616286 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:45:04.616585 10541 external_mini_cluster.cc:1428] Setting key 82010cd76309ad82afbd59e7a58108f4
I20260812 02:45:04.607493 1603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:45119 every 8 connection(s)
Aug 12 02:45:04 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502704, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:04.631093 1336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:04.610984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:36451 (local address 127.10.75.126:43039)
0812 02:45:04.611129 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:04.611134 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:04.611838 (+ 704us) server_negotiation.cc:407] Connection header received
0812 02:45:04.613079 (+ 1241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:04.613083 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:04.613138 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:04.613193 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:04.614922 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:04.615804 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:04.622250 (+ 6446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:04.622649 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:04.622741 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:04.626047 (+ 3306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:04.626053 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:04.626132 (+ 79us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:04.626170 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:04.628135 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:04.628862 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:04.628867 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:04.628868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:04.628962 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:04.629430 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:04.629436 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:04.629441 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:04.629715 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:04.629820 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:04.630709 (+ 889us) server_negotiation.cc:299] Negotiation successful
0812 02:45:04.630871 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 02:45:04.633308 1606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:04.609799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:43039 (local address 127.10.75.66:36451)
0812 02:45:04.611675 (+ 1876us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:04.611731 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:04.612819 (+ 1088us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:04.613611 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:04.613621 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:04.613978 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:04.614656 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:04.614674 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:04.617647 (+ 2973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:04.617650 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:04.622024 (+ 4374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:04.622042 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:04.622994 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:04.622999 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:04.623228 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:04.624013 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:04.624039 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:04.625828 (+ 1789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:04.628294 (+ 2466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:04.628303 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:04.628325 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:04.628732 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:04.629092 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:04.629098 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:04.629103 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:04.629310 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:04.629912 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:04.629922 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:04.630349 (+ 427us) client_negotiation.cc:769] Sending connection context
0812 02:45:04.631571 (+ 1222us) client_negotiation.cc:240] Negotiation successful
0812 02:45:04.632023 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1649,"thread_start_us":196,"threads_started":1}
I20260812 02:45:04.635298 1604 heartbeater.cc:347] Connected to a master server at 127.10.75.126:43039
I20260812 02:45:04.635617 1604 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:04.636265 1604 heartbeater.cc:511] Master 127.10.75.126:43039 requested a full tablet report, sending...
I20260812 02:45:04.637426 905 ts_manager.cc:194] Registered new tserver with Master: fa617a56ad5b4fada53cc18664d1fc43 (127.10.75.66:45119)
I20260812 02:45:04.638154 905 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:36451
WARNING: no policy specified for kudu/127.10.75.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
I20260812 02:45:04.665565 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.75.84:35509/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43039
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:40573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 02:45:04 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502704, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
W20260812 02:45:04.844720 1611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:04.845176 1611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:04.845270 1611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:04.852047 1611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:04.852190 1611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:04.852329 1611 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:45:04.861800 1611 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:40573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.10.75.84:35509/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:04.863530 1611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:04.865193 1611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:04.878381 1618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:04.878443 1624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:04.878338 1619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:04.880055 1611 server_base.cc:1034] running on GCE node
I20260812 02:45:04.880530 1611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:04.881306 1611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:04.882606 1611 hybrid_clock.cc:648] HybridClock initialized: now 1786502704882580 us; error 38 us; skew 500 ppm
Aug 12 02:45:04 dist-test-slave-2p8l krb5kdc[32472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502704, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:04.890329 1611 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:45:04.891523 1611 webserver.cc:460] Webserver started at http://127.10.75.67:46105/ using document root <none> and password file <none>
I20260812 02:45:04.892271 1611 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:04.892433 1611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:04.892679 1611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 02:45:04 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502704, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
I20260812 02:45:04.912885 1611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "fd2d9135b8124cac9d9b5c9ad063072e"
format_stamp: "Formatted at 2026-08-12 02:45:04 on dist-test-slave-2p8l"
server_key: "04fc5d4d8ef77178e2298fd80f0ebedd"
server_key_iv: "d1d8e62d5398da77781092d68b921d2e"
server_key_version: "kuduclusterkey@0"
I20260812 02:45:04.913692 1611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "fd2d9135b8124cac9d9b5c9ad063072e"
format_stamp: "Formatted at 2026-08-12 02:45:04 on dist-test-slave-2p8l"
server_key: "04fc5d4d8ef77178e2298fd80f0ebedd"
server_key_iv: "d1d8e62d5398da77781092d68b921d2e"
server_key_version: "kuduclusterkey@0"
I20260812 02:45:04.918987 1611 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 02:45:04.938131 1641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:04.939844 1611 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260812 02:45:04.939987 1611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "fd2d9135b8124cac9d9b5c9ad063072e"
format_stamp: "Formatted at 2026-08-12 02:45:04 on dist-test-slave-2p8l"
server_key: "04fc5d4d8ef77178e2298fd80f0ebedd"
server_key_iv: "d1d8e62d5398da77781092d68b921d2e"
server_key_version: "kuduclusterkey@0"
I20260812 02:45:04.940124 1611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:04.969699 1611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:04.973675 1611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:04.973881 1611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:04.974633 1611 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:04.975723 1611 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:45:04.975786 1611 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:04.975840 1611 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:45:04.975919 1611 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260812 02:45:04.987545 1611 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:36575
I20260812 02:45:04.987622 1875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:36575 every 8 connection(s)
I20260812 02:45:04.988796 1611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:45:04.997256 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 1611
I20260812 02:45:04.997382 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:45:04.997655 10541 external_mini_cluster.cc:1428] Setting key 2ed67767a4dd5b52c803a5f2252494f7
Aug 12 02:45:04 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502704, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:05.006047 1336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:04.990998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:49681 (local address 127.10.75.126:43039)
0812 02:45:04.991144 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:04.991148 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:04.992290 (+ 1142us) server_negotiation.cc:407] Connection header received
0812 02:45:04.993539 (+ 1249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:04.993543 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:04.993602 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:04.993657 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:04.995348 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:04.996192 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:04.997934 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:04.998294 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:04.998379 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:05.001609 (+ 3230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:05.001613 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:05.001616 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:05.001646 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:05.003549 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:05.004191 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:05.004195 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:05.004198 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:05.004294 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:05.004729 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:05.004732 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:05.004734 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:05.004965 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:05.005073 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:05.005733 (+ 660us) server_negotiation.cc:299] Negotiation successful
0812 02:45:05.005876 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 02:45:05.007117 1879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:04.991495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:43039 (local address 127.10.75.67:49681)
0812 02:45:04.992102 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:04.992173 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:04.993281 (+ 1108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:04.994053 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:04.994087 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:04.994456 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:04.995156 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:04.995178 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:04.996374 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:04.996377 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:04.997781 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:04.997793 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:04.998654 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:04.998659 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:04.998876 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:04.999549 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:04.999574 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:05.001403 (+ 1829us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:05.003685 (+ 2282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:05.003692 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:05.003709 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:05.004068 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:05.004404 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:05.004407 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:05.004409 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:05.004620 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:05.005085 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:05.005092 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:05.005421 (+ 329us) client_negotiation.cc:769] Sending connection context
0812 02:45:05.005650 (+ 229us) client_negotiation.cc:240] Negotiation successful
0812 02:45:05.006007 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":156,"threads_started":1}
I20260812 02:45:05.008436 1876 heartbeater.cc:347] Connected to a master server at 127.10.75.126:43039
I20260812 02:45:05.008709 1876 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:05.009318 1876 heartbeater.cc:511] Master 127.10.75.126:43039 requested a full tablet report, sending...
I20260812 02:45:05.010779 903 ts_manager.cc:194] Registered new tserver with Master: fd2d9135b8124cac9d9b5c9ad063072e (127.10.75.67:36575)
I20260812 02:45:05.011435 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:45:05.011567 903 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:49681
I20260812 02:45:05.012226 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 1062
I20260812 02:45:05.026775 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 1341
I20260812 02:45:05.066843 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 1611
I20260812 02:45:05.099828 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 835
I20260812 02:45:05.123747 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:43039
--webserver_interface=127.10.75.126
--webserver_port=44391
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:40573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:43039
--ranger_config_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.75.84:35509/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.75.84:35509/kms with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:45:05.248128 1881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:05.248515 1881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:05.248594 1881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:05.252918 1881 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:45:05.253049 1881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:05.253087 1881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:05.253129 1881 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:45:05.253162 1881 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:45:05.260015 1881 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:40573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.75.84:35509/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:43039
--ranger_config_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:43039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=44391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:05.261404 1881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:05.262684 1881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:05.273504 1890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:05.273497 1898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:05.273624 1881 server_base.cc:1034] running on GCE node
W20260812 02:45:05.273497 1887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:05.274642 1881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:05.275970 1881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:05.277209 1881 hybrid_clock.cc:648] HybridClock initialized: now 1786502705277172 us; error 55 us; skew 500 ppm
Aug 12 02:45:05 dist-test-slave-2p8l krb5kdc[32472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502705, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:05.280928 1881 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:45:05.282397 1881 webserver.cc:460] Webserver started at http://127.10.75.126:44391/ using document root <none> and password file <none>
I20260812 02:45:05.283066 1881 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:05.283185 1881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 02:45:05 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502705, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
I20260812 02:45:05.369730 1881 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 02:45:05.372400 1914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:05.373943 1881 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 02:45:05.374168 1881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "2503915edd684ea885700aaea8837698"
format_stamp: "Formatted at 2026-08-12 02:45:03 on dist-test-slave-2p8l"
server_key: "c1ddb150b27c7b9fdbd6fbf34ce606d4"
server_key_iv: "a647ceaa718919b8bc29e20ea541f902"
server_key_version: "kuduclusterkey@0"
I20260812 02:45:05.374800 1881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:05.389961 1881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:05.393505 1881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:05.393759 1881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:05.402135 1881 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:43039
I20260812 02:45:05.402275 2026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:43039 every 8 connection(s)
I20260812 02:45:05.403496 1881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:45:05.404803 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 1881
I20260812 02:45:05.405357 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.75.84:35509/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:46067
--local_ip_for_outbound_sockets=127.10.75.65
--tserver_master_addrs=127.10.75.126:43039
--webserver_port=38015
--webserver_interface=127.10.75.65
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:40573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.75.84:35509/kms with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:45:05.409443 2027 sys_catalog.cc:263] Verifying existing consensus state
I20260812 02:45:05.411480 2027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698: Bootstrap starting.
I20260812 02:45:05.428961 2027 log.cc:824] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:05.436654 2027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 02:45:05.437153 2027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698: Bootstrap complete.
I20260812 02:45:05.441689 2027 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2503915edd684ea885700aaea8837698" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43039 } }
I20260812 02:45:05.442162 2027 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2503915edd684ea885700aaea8837698, State: Initialized, Role: FOLLOWER
I20260812 02:45:05.442754 2027 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2503915edd684ea885700aaea8837698" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43039 } }
I20260812 02:45:05.442879 2027 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:45:05.442971 2027 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:45:05.443074 2027 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [term 1 FOLLOWER]: Advancing to term 2
I20260812 02:45:05.445143 2027 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2503915edd684ea885700aaea8837698" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43039 } }
I20260812 02:45:05.445508 2027 leader_election.cc:302] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2503915edd684ea885700aaea8837698; no voters:
I20260812 02:45:05.445883 2027 leader_election.cc:288] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 02:45:05.445982 2035 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 02:45:05.446254 2035 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [term 2 LEADER]: Becoming Leader. State: Replica: 2503915edd684ea885700aaea8837698, State: Running, Role: LEADER
I20260812 02:45:05.446630 2035 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2503915edd684ea885700aaea8837698" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43039 } }
I20260812 02:45:05.447321 2027 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:45:05.448081 2046 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2503915edd684ea885700aaea8837698. Latest consensus state: current_term: 2 leader_uuid: "2503915edd684ea885700aaea8837698" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2503915edd684ea885700aaea8837698" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43039 } } }
I20260812 02:45:05.448217 2046 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [sys.catalog]: This master's current role is: LEADER
I20260812 02:45:05.448575 2045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2503915edd684ea885700aaea8837698" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2503915edd684ea885700aaea8837698" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43039 } } }
I20260812 02:45:05.448657 2045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698 [sys.catalog]: This master's current role is: LEADER
I20260812 02:45:05.449620 2050 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:45:05.449900 2027 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 02:45:05.456295 2050 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:45:05.457506 2050 catalog_manager.cc:1259] Loaded cluster ID: 527ef4b474fd4481b18dced02f83901a
I20260812 02:45:05.457623 2050 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:45:05.460682 2050 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:45:05.461695 2050 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698: Loaded TSK: 0
I20260812 02:45:05.463090 2050 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 02:45:05.558913 2032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:05.559749 2032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:05.559917 2032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:05.566596 2032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:05.566692 2032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:05.566785 2032 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:45:05.574955 2032 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:40573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.75.84:35509/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:46067
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=38015
--tserver_master_addrs=127.10.75.126:43039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:05.576606 2032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:05.577971 2032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:05.591387 2098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:05.591442 2105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:05.591380 2101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:05.591931 2032 server_base.cc:1034] running on GCE node
I20260812 02:45:05.592582 2032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:05.593451 2032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:05.600910 2032 hybrid_clock.cc:648] HybridClock initialized: now 1786502705600849 us; error 62 us; skew 500 ppm
Aug 12 02:45:05 dist-test-slave-2p8l krb5kdc[32472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502705, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:05.605048 2032 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:45:05.606477 2032 webserver.cc:460] Webserver started at http://127.10.75.65:38015/ using document root <none> and password file <none>
I20260812 02:45:05.607360 2032 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:05.607534 2032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 02:45:05 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502705, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
I20260812 02:45:05.643864 2032 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.003s sys 0.001s
I20260812 02:45:05.650983 2118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:05.653244 2032 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.002s sys 0.000s
I20260812 02:45:05.653513 2032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "4e4e65965fbe4819bfff62e0792a8abd"
format_stamp: "Formatted at 2026-08-12 02:45:04 on dist-test-slave-2p8l"
server_key: "ed938a34cec0bd68fe99b5c0c138dfad"
server_key_iv: "8cf5c685c8cbac58fb9927d89c4f9700"
server_key_version: "kuduclusterkey@0"
I20260812 02:45:05.654556 2032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:05.677618 2032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:05.682341 2032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:05.682693 2032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:05.683736 2032 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:05.685158 2032 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:45:05.685284 2032 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 02:45:05.685439 2032 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:45:05.685546 2032 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:05.698943 2032 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:46067
I20260812 02:45:05.700523 2032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:45:05.701467 2345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:46067 every 8 connection(s)
I20260812 02:45:05.709447 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 2032
I20260812 02:45:05.710093 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.75.84:35509/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:45119
--local_ip_for_outbound_sockets=127.10.75.66
--tserver_master_addrs=127.10.75.126:43039
--webserver_port=34341
--webserver_interface=127.10.75.66
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:40573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.75.84:35509/kms with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 02:45:05 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502705, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:05.725558 2354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:05.703616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:43039 (local address 127.10.75.65:50091)
0812 02:45:05.704454 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:05.704539 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:05.705661 (+ 1122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:05.707429 (+ 1768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:05.707439 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:05.707857 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:05.708659 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:05.708687 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:05.710977 (+ 2290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:05.710981 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:05.712513 (+ 1532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:05.712530 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:05.714291 (+ 1761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:05.714298 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:05.714572 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:05.715577 (+ 1005us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:05.715602 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:05.717632 (+ 2030us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:05.720967 (+ 3335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:05.720975 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:05.720995 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:05.721440 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:05.721963 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:05.721967 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:05.721969 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:05.722234 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:05.723179 (+ 945us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:05.723189 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:05.723547 (+ 358us) client_negotiation.cc:769] Sending connection context
0812 02:45:05.723786 (+ 239us) client_negotiation.cc:240] Negotiation successful
0812 02:45:05.724282 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":149,"threads_started":1}
I20260812 02:45:05.728536 2352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:05.703457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:50091 (local address 127.10.75.126:43039)
0812 02:45:05.704121 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:05.704146 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:05.706022 (+ 1876us) server_negotiation.cc:407] Connection header received
0812 02:45:05.706411 (+ 389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:05.706427 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:05.706867 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:05.707273 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:05.708919 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:05.710762 (+ 1843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:05.712957 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:05.713883 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:05.715314 (+ 1431us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:05.718028 (+ 2714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:05.718038 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:05.718086 (+ 48us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:05.718131 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:05.720769 (+ 2638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:05.721631 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:05.721639 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:05.721646 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:05.721825 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:05.722386 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:05.722389 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:05.722391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:05.723003 (+ 612us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:05.726853 (+ 3850us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:05.727071 (+ 218us) server_negotiation.cc:299] Negotiation successful
0812 02:45:05.727435 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":119,"threads_started":1}
I20260812 02:45:05.732266 2349 heartbeater.cc:347] Connected to a master server at 127.10.75.126:43039
I20260812 02:45:05.732570 2349 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:05.733286 2349 heartbeater.cc:511] Master 127.10.75.126:43039 requested a full tablet report, sending...
W20260812 02:45:05.736129 2349 heartbeater.cc:644] Failed to heartbeat to 127.10.75.126:43039 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 02:45:05.736268 2349 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:05.736477 2349 heartbeater.cc:511] Master 127.10.75.126:43039 requested a full tablet report, sending...
I20260812 02:45:05.737556 2349 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:05.737753 2349 heartbeater.cc:511] Master 127.10.75.126:43039 requested a full tablet report, sending...
W20260812 02:45:05.738643 2349 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 02:45:05.904798 2355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:05.905225 2355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:05.905304 2355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:05.911899 2355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:05.912004 2355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:05.912110 2355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:45:05.920711 2355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:40573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.75.84:35509/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:45119
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=34341
--tserver_master_addrs=127.10.75.126:43039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:05.922544 2355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:05.924218 2355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:05.942893 2367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:05.943228 2370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:05.942930 2363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:05.943707 2355 server_base.cc:1034] running on GCE node
I20260812 02:45:05.944343 2355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:05.946187 2355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:05.947443 2355 hybrid_clock.cc:648] HybridClock initialized: now 1786502705947399 us; error 61 us; skew 500 ppm
Aug 12 02:45:05 dist-test-slave-2p8l krb5kdc[32472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502705, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:05.952198 2355 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:45:05.953822 2355 webserver.cc:460] Webserver started at http://127.10.75.66:34341/ using document root <none> and password file <none>
I20260812 02:45:05.954766 2355 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:05.954959 2355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 02:45:05 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502705, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
I20260812 02:45:05.990578 2355 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 02:45:05.994467 2389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:05.996342 2355 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 02:45:05.996500 2355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "fa617a56ad5b4fada53cc18664d1fc43"
format_stamp: "Formatted at 2026-08-12 02:45:04 on dist-test-slave-2p8l"
server_key: "a82b26fd492387a8859773cd8fab22de"
server_key_iv: "9175356efb8d62005de7767441536c03"
server_key_version: "kuduclusterkey@0"
I20260812 02:45:05.997298 2355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:06.040655 2355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:06.044952 2355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:06.045308 2355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:06.046168 2355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:06.047350 2355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:45:06.047420 2355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:06.047482 2355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:45:06.047518 2355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:06.059659 2355 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:45119
I20260812 02:45:06.061192 2355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:45:06.062790 2594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:45119 every 8 connection(s)
I20260812 02:45:06.070626 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 2355
I20260812 02:45:06.071177 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.75.84:35509/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:36575
--local_ip_for_outbound_sockets=127.10.75.67
--tserver_master_addrs=127.10.75.126:43039
--webserver_port=46105
--webserver_interface=127.10.75.67
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:40573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.75.84:35509/kms with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 02:45:06 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502705, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:06.079133 2352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:06.063926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:60279 (local address 127.10.75.126:43039)
0812 02:45:06.064119 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:06.064125 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:06.065214 (+ 1089us) server_negotiation.cc:407] Connection header received
0812 02:45:06.066525 (+ 1311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:06.066529 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:06.066581 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:06.066675 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:06.068212 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:06.068751 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:06.070569 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:06.070942 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:06.071038 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:06.074680 (+ 3642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:06.074686 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:06.074690 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:06.074729 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:06.076358 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:06.076956 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:06.076959 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:06.076961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:06.077052 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:06.077553 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:06.077556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:06.077566 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:06.077771 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:06.077886 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:06.078745 (+ 859us) server_negotiation.cc:299] Negotiation successful
0812 02:45:06.078920 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 02:45:06.080094 2606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:06.064411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:43039 (local address 127.10.75.66:60279)
0812 02:45:06.065009 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:06.065071 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:06.066256 (+ 1185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:06.066915 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:06.066925 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:06.067311 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:06.068009 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:06.068032 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:06.068901 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:06.068906 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:06.070398 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:06.070413 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:06.071367 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:06.071372 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:06.071597 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:06.072420 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:06.072444 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:06.074417 (+ 1973us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:06.076502 (+ 2085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:06.076509 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:06.076529 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:06.076837 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:06.077275 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:06.077278 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:06.077279 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:06.077428 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:06.077945 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:06.077951 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:06.078373 (+ 422us) client_negotiation.cc:769] Sending connection context
0812 02:45:06.078686 (+ 313us) client_negotiation.cc:240] Negotiation successful
0812 02:45:06.079047 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":136,"threads_started":1}
I20260812 02:45:06.081442 2600 heartbeater.cc:347] Connected to a master server at 127.10.75.126:43039
I20260812 02:45:06.081709 2600 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:06.082301 2600 heartbeater.cc:511] Master 127.10.75.126:43039 requested a full tablet report, sending...
W20260812 02:45:06.084019 2600 heartbeater.cc:644] Failed to heartbeat to 127.10.75.126:43039 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 02:45:06.084158 2600 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:06.084362 2600 heartbeater.cc:511] Master 127.10.75.126:43039 requested a full tablet report, sending...
I20260812 02:45:06.085254 2600 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:06.085453 2600 heartbeater.cc:511] Master 127.10.75.126:43039 requested a full tablet report, sending...
W20260812 02:45:06.087186 2600 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 02:45:06.250499 2607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:06.250913 2607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:06.250995 2607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:06.257304 2607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:06.257398 2607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:06.257499 2607 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:45:06.266171 2607 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:40573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.75.84:35509/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:36575
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=46105
--tserver_master_addrs=127.10.75.126:43039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:06.267692 2607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:06.269353 2607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:06.283447 2617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:06.283569 2613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:06.283641 2614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:06.284322 2607 server_base.cc:1034] running on GCE node
I20260812 02:45:06.284893 2607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:06.285818 2607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:06.287029 2607 hybrid_clock.cc:648] HybridClock initialized: now 1786502706286996 us; error 48 us; skew 500 ppm
Aug 12 02:45:06 dist-test-slave-2p8l krb5kdc[32472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502706, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:06.291234 2607 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:45:06.292546 2607 webserver.cc:460] Webserver started at http://127.10.75.67:46105/ using document root <none> and password file <none>
I20260812 02:45:06.293395 2607 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:06.293517 2607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 02:45:06 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502706, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
I20260812 02:45:06.317675 2607 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.004s sys 0.000s
I20260812 02:45:06.322876 2631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:06.324622 2607 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 02:45:06.324760 2607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "fd2d9135b8124cac9d9b5c9ad063072e"
format_stamp: "Formatted at 2026-08-12 02:45:04 on dist-test-slave-2p8l"
server_key: "04fc5d4d8ef77178e2298fd80f0ebedd"
server_key_iv: "d1d8e62d5398da77781092d68b921d2e"
server_key_version: "kuduclusterkey@0"
I20260812 02:45:06.325367 2607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:06.354626 2607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:06.358143 2607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:06.358366 2607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:06.359072 2607 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:06.360059 2607 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:45:06.360132 2607 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:06.360204 2607 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:45:06.360248 2607 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:06.371752 2607 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:36575
I20260812 02:45:06.371867 2855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:36575 every 8 connection(s)
I20260812 02:45:06.372840 2607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:45:06.374619 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 2607
Aug 12 02:45:06 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502706, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:06.388203 2861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:06.376861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59796 (local address 127.10.75.126:43039)
0812 02:45:06.377131 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:06.377142 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:06.377157 (+ 15us) server_negotiation.cc:407] Connection header received
0812 02:45:06.377205 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:06.377208 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:06.377258 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:06.377360 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:06.378599 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:06.379564 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:06.380810 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:06.381169 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:06.381291 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:06.383801 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:06.383805 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:06.383808 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:06.383839 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:06.385946 (+ 2107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:06.386530 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:06.386534 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:06.386536 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:06.386641 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:06.387036 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:06.387041 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:06.387044 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:06.387290 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:06.387511 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:06.387845 (+ 334us) server_negotiation.cc:299] Negotiation successful
0812 02:45:06.387988 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":123,"threads_started":1}
I20260812 02:45:06.395232 2352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:06.376782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:39599 (local address 127.10.75.126:43039)
0812 02:45:06.376937 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:06.376942 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:06.376958 (+ 16us) server_negotiation.cc:407] Connection header received
0812 02:45:06.377316 (+ 358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:06.377319 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:06.377367 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:06.377446 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:06.378898 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:06.379473 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:06.381058 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:06.381337 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:06.381430 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:06.390748 (+ 9318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:06.390753 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:06.390756 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:06.390784 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:06.392644 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:06.393352 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:06.393356 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:06.393358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:06.393465 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:06.393906 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:06.393910 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:06.393911 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:06.394200 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:06.394316 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:06.394915 (+ 599us) server_negotiation.cc:299] Negotiation successful
0812 02:45:06.395061 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 02:45:06.396109 2859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:06.375550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:43039 (local address 127.10.75.67:39599)
0812 02:45:06.376128 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:06.376171 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:06.377112 (+ 941us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:06.377632 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:06.377643 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:06.377995 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:06.378762 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:06.378779 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:06.379605 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:06.379609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:06.380930 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:06.380941 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:06.381598 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:06.381604 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:06.381799 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:06.382405 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:06.382429 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:06.390521 (+ 8092us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:06.392790 (+ 2269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:06.392797 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:06.392817 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:06.393221 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:06.393582 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:06.393586 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:06.393588 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:06.393792 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:06.394332 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:06.394340 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:06.394652 (+ 312us) client_negotiation.cc:769] Sending connection context
0812 02:45:06.394833 (+ 181us) client_negotiation.cc:240] Negotiation successful
0812 02:45:06.395117 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":179,"threads_started":1}
I20260812 02:45:06.397434 2856 heartbeater.cc:347] Connected to a master server at 127.10.75.126:43039
I20260812 02:45:06.397710 2856 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:06.398362 2856 heartbeater.cc:511] Master 127.10.75.126:43039 requested a full tablet report, sending...
I20260812 02:45:06.400815 1947 ts_manager.cc:194] Registered new tserver with Master: fd2d9135b8124cac9d9b5c9ad063072e (127.10.75.67:36575)
I20260812 02:45:06.402539 1947 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:39599
Aug 12 02:45:06 dist-test-slave-2p8l krb5kdc[32472](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786502706, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:06.738891 2349 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:06.739264 2349 heartbeater.cc:511] Master 127.10.75.126:43039 requested a full tablet report, sending...
I20260812 02:45:06.740422 1947 ts_manager.cc:194] Registered new tserver with Master: 4e4e65965fbe4819bfff62e0792a8abd (127.10.75.65:46067)
I20260812 02:45:06.741262 1947 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:50091
I20260812 02:45:07.087468 2600 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:07.087836 2600 heartbeater.cc:511] Master 127.10.75.126:43039 requested a full tablet report, sending...
I20260812 02:45:07.088675 1946 ts_manager.cc:194] Registered new tserver with Master: fa617a56ad5b4fada53cc18664d1fc43 (127.10.75.66:45119)
I20260812 02:45:07.089479 1946 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:60279
I20260812 02:45:07.089534 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:45:07.101899 2880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:07.091424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59806 (local address 127.10.75.126:43039)
0812 02:45:07.091963 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:07.091968 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:07.092110 (+ 142us) server_negotiation.cc:407] Connection header received
0812 02:45:07.092241 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:07.092244 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:07.092294 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:07.092388 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:07.093249 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.094090 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.095299 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.095652 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.095755 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:07.097598 (+ 1843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:07.097602 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:07.097605 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:07.097634 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:07.099735 (+ 2101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:07.100289 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:07.100293 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:07.100295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:07.100387 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:07.100749 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:07.100753 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:07.100755 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:07.101000 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:07.101141 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:07.101515 (+ 374us) server_negotiation.cc:299] Negotiation successful
0812 02:45:07.101651 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":85,"threads_started":1}
I20260812 02:45:07.106551 1946 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59806:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:45:07.111099 1946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 12 02:45:07 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502706, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
I20260812 02:45:07.142815 2891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:07.130402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:46067 (local address 127.0.0.1:60046)
0812 02:45:07.136251 (+ 5849us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:07.136309 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:07.136455 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:07.137246 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:07.137252 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:07.137276 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:07.137409 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:07.137415 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.139214 (+ 1799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.139217 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:07.140603 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:07.140614 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.141949 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.141953 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:07.142352 (+ 399us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:07.142405 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 02:45:07.142518 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 02:45:07.142642 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5630,"thread_start_us":118,"threads_started":1}
I20260812 02:45:07.143715 2892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:07.130513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60046 (local address 127.10.75.65:46067)
0812 02:45:07.136286 (+ 5773us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:07.136294 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:07.136595 (+ 301us) server_negotiation.cc:407] Connection header received
0812 02:45:07.136692 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:07.136697 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:07.136920 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:07.137070 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:07.137541 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.139078 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.140766 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.141610 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.141729 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:07.141883 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:07.143450 (+ 1567us) server_negotiation.cc:299] Negotiation successful
0812 02:45:07.143564 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5647,"thread_start_us":94,"threads_started":1}
I20260812 02:45:07.147297 2215 tablet_service.cc:1467] Processing CreateTablet for tablet 7c7b27ad72d34f469d2c2220cda5bc22 (DEFAULT_TABLE table=test-table [id=f50280c946964c63bb516da253b28943]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:45:07.149698 2899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:07.133556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:36575 (local address 127.0.0.1:54822)
0812 02:45:07.138533 (+ 4977us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:07.138545 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:07.138640 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:07.141365 (+ 2725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:07.141368 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:07.141386 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:07.141471 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:07.141477 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.145590 (+ 4113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.145593 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:07.147647 (+ 2054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:07.147659 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.149108 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.149111 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:07.149256 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:07.149282 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 02:45:07.149359 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 02:45:07.149504 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4902,"mutex_wait_us":3,"thread_start_us":92,"threads_started":1}
I20260812 02:45:07.150216 2901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:07.133961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54822 (local address 127.10.75.67:36575)
0812 02:45:07.140701 (+ 6740us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:07.140709 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:07.140736 (+ 27us) server_negotiation.cc:407] Connection header received
0812 02:45:07.140816 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:07.140822 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:07.141032 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:07.141206 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:07.144299 (+ 3093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.145437 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.147794 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.148765 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.148883 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:07.149035 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:07.149918 (+ 883us) server_negotiation.cc:299] Negotiation successful
0812 02:45:07.150038 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6622,"thread_start_us":159,"threads_started":1}
I20260812 02:45:07.156704 2740 tablet_service.cc:1467] Processing CreateTablet for tablet 7c7b27ad72d34f469d2c2220cda5bc22 (DEFAULT_TABLE table=test-table [id=f50280c946964c63bb516da253b28943]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:45:07.158814 2215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c7b27ad72d34f469d2c2220cda5bc22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:07.159561 2740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c7b27ad72d34f469d2c2220cda5bc22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:07.174748 2895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:07.132375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:45119 (local address 127.0.0.1:35692)
0812 02:45:07.136436 (+ 4061us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:07.136450 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:07.136543 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:07.138191 (+ 1648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:07.138194 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:07.138211 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:07.138315 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:07.138322 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.142119 (+ 3797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.142123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:07.144128 (+ 2005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:07.144140 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.149108 (+ 4968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.149111 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:07.174310 (+ 25199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:07.174351 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 02:45:07.174452 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 02:45:07.174551 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3997,"mutex_wait_us":25003,"thread_start_us":99,"threads_started":1}
I20260812 02:45:07.174919 2898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:07.132804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35692 (local address 127.10.75.66:45119)
0812 02:45:07.136845 (+ 4041us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:07.136853 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:07.136875 (+ 22us) server_negotiation.cc:407] Connection header received
0812 02:45:07.136951 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:07.136957 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:07.137176 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:07.138751 (+ 1575us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:07.138906 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.141930 (+ 3024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.147850 (+ 5920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.148767 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.148883 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:07.149035 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:07.174591 (+ 25556us) server_negotiation.cc:299] Negotiation successful
0812 02:45:07.174750 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3935,"thread_start_us":107,"threads_started":1}
I20260812 02:45:07.178634 2480 tablet_service.cc:1467] Processing CreateTablet for tablet 7c7b27ad72d34f469d2c2220cda5bc22 (DEFAULT_TABLE table=test-table [id=f50280c946964c63bb516da253b28943]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:45:07.179898 2480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c7b27ad72d34f469d2c2220cda5bc22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:07.190503 2904 tablet_bootstrap.cc:492] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e: Bootstrap starting.
I20260812 02:45:07.190503 2906 tablet_bootstrap.cc:492] T 7c7b27ad72d34f469d2c2220cda5bc22 P 4e4e65965fbe4819bfff62e0792a8abd: Bootstrap starting.
I20260812 02:45:07.193389 2904 tablet_bootstrap.cc:654] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:07.194074 2907 tablet_bootstrap.cc:492] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43: Bootstrap starting.
I20260812 02:45:07.197666 2907 tablet_bootstrap.cc:654] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:07.198395 2906 tablet_bootstrap.cc:654] T 7c7b27ad72d34f469d2c2220cda5bc22 P 4e4e65965fbe4819bfff62e0792a8abd: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:07.199350 2906 log.cc:824] T 7c7b27ad72d34f469d2c2220cda5bc22 P 4e4e65965fbe4819bfff62e0792a8abd: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:07.203061 2904 log.cc:824] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:07.204667 2906 tablet_bootstrap.cc:492] T 7c7b27ad72d34f469d2c2220cda5bc22 P 4e4e65965fbe4819bfff62e0792a8abd: No bootstrap required, opened a new log
I20260812 02:45:07.204924 2906 ts_tablet_manager.cc:1397] T 7c7b27ad72d34f469d2c2220cda5bc22 P 4e4e65965fbe4819bfff62e0792a8abd: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.000s
I20260812 02:45:07.205144 2907 log.cc:824] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:07.209236 2906 raft_consensus.cc:348] T 7c7b27ad72d34f469d2c2220cda5bc22 P 4e4e65965fbe4819bfff62e0792a8abd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e4e65965fbe4819bfff62e0792a8abd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46067 } } peers { permanent_uuid: "fa617a56ad5b4fada53cc18664d1fc43" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45119 } } peers { permanent_uuid: "fd2d9135b8124cac9d9b5c9ad063072e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 36575 } }
I20260812 02:45:07.209664 2906 raft_consensus.cc:374] T 7c7b27ad72d34f469d2c2220cda5bc22 P 4e4e65965fbe4819bfff62e0792a8abd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:07.209784 2906 raft_consensus.cc:729] T 7c7b27ad72d34f469d2c2220cda5bc22 P 4e4e65965fbe4819bfff62e0792a8abd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e4e65965fbe4819bfff62e0792a8abd, State: Initialized, Role: FOLLOWER
I20260812 02:45:07.210522 2906 consensus_queue.cc:260] T 7c7b27ad72d34f469d2c2220cda5bc22 P 4e4e65965fbe4819bfff62e0792a8abd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e4e65965fbe4819bfff62e0792a8abd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46067 } } peers { permanent_uuid: "fa617a56ad5b4fada53cc18664d1fc43" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45119 } } peers { permanent_uuid: "fd2d9135b8124cac9d9b5c9ad063072e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 36575 } }
I20260812 02:45:07.212167 2906 ts_tablet_manager.cc:1428] T 7c7b27ad72d34f469d2c2220cda5bc22 P 4e4e65965fbe4819bfff62e0792a8abd: Time spent starting tablet: real 0.007s user 0.001s sys 0.004s
I20260812 02:45:07.212671 2349 heartbeater.cc:503] Master 127.10.75.126:43039 was elected leader, sending a full tablet report...
I20260812 02:45:07.216403 2904 tablet_bootstrap.cc:492] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e: No bootstrap required, opened a new log
I20260812 02:45:07.216703 2904 ts_tablet_manager.cc:1397] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.000s
I20260812 02:45:07.218367 2907 tablet_bootstrap.cc:492] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43: No bootstrap required, opened a new log
I20260812 02:45:07.218657 2907 ts_tablet_manager.cc:1397] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.002s
I20260812 02:45:07.220809 2904 raft_consensus.cc:348] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e4e65965fbe4819bfff62e0792a8abd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46067 } } peers { permanent_uuid: "fa617a56ad5b4fada53cc18664d1fc43" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45119 } } peers { permanent_uuid: "fd2d9135b8124cac9d9b5c9ad063072e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 36575 } }
I20260812 02:45:07.221079 2904 raft_consensus.cc:374] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:07.221190 2904 raft_consensus.cc:729] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd2d9135b8124cac9d9b5c9ad063072e, State: Initialized, Role: FOLLOWER
I20260812 02:45:07.221818 2904 consensus_queue.cc:260] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e4e65965fbe4819bfff62e0792a8abd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46067 } } peers { permanent_uuid: "fa617a56ad5b4fada53cc18664d1fc43" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45119 } } peers { permanent_uuid: "fd2d9135b8124cac9d9b5c9ad063072e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 36575 } }
I20260812 02:45:07.222703 2907 raft_consensus.cc:348] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e4e65965fbe4819bfff62e0792a8abd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46067 } } peers { permanent_uuid: "fa617a56ad5b4fada53cc18664d1fc43" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45119 } } peers { permanent_uuid: "fd2d9135b8124cac9d9b5c9ad063072e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 36575 } }
I20260812 02:45:07.222995 2907 raft_consensus.cc:374] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:07.223066 2907 raft_consensus.cc:729] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa617a56ad5b4fada53cc18664d1fc43, State: Initialized, Role: FOLLOWER
I20260812 02:45:07.223217 2904 ts_tablet_manager.cc:1428] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e: Time spent starting tablet: real 0.006s user 0.000s sys 0.006s
I20260812 02:45:07.223616 2856 heartbeater.cc:503] Master 127.10.75.126:43039 was elected leader, sending a full tablet report...
I20260812 02:45:07.223577 2907 consensus_queue.cc:260] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e4e65965fbe4819bfff62e0792a8abd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46067 } } peers { permanent_uuid: "fa617a56ad5b4fada53cc18664d1fc43" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45119 } } peers { permanent_uuid: "fd2d9135b8124cac9d9b5c9ad063072e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 36575 } }
I20260812 02:45:07.224591 2907 ts_tablet_manager.cc:1428] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43: Time spent starting tablet: real 0.006s user 0.004s sys 0.002s
I20260812 02:45:07.224920 2600 heartbeater.cc:503] Master 127.10.75.126:43039 was elected leader, sending a full tablet report...
W20260812 02:45:07.314757 2601 tablet.cc:2369] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 02:45:07.374672 2857 tablet.cc:2369] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 02:45:07 dist-test-slave-2p8l krb5kdc[32472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502706, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for HTTP/127.10.75.84@KRBTEST.COM
W20260812 02:45:07.456516 2351 tablet.cc:2369] T 7c7b27ad72d34f469d2c2220cda5bc22 P 4e4e65965fbe4819bfff62e0792a8abd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:45:07.481385 2917 raft_consensus.cc:482] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:45:07.481612 2917 raft_consensus.cc:504] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e4e65965fbe4819bfff62e0792a8abd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46067 } } peers { permanent_uuid: "fa617a56ad5b4fada53cc18664d1fc43" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45119 } } peers { permanent_uuid: "fd2d9135b8124cac9d9b5c9ad063072e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 36575 } }
I20260812 02:45:07.483081 2917 leader_election.cc:288] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e4e65965fbe4819bfff62e0792a8abd (127.10.75.65:46067), fd2d9135b8124cac9d9b5c9ad063072e (127.10.75.67:36575)
I20260812 02:45:07.505882 2924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:07.484438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:46067 (local address 127.10.75.66:57939)
0812 02:45:07.497412 (+ 12974us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:07.497430 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:07.497615 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:07.497919 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:07.497922 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:07.497942 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:07.498126 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:07.498135 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.502970 (+ 4835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.502974 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:07.504284 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:07.504300 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.505366 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.505373 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:07.505490 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:07.505528 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 02:45:07.505602 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 02:45:07.505689 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12878,"thread_start_us":124,"threads_started":1}
I20260812 02:45:07.506538 2892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:07.484840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:57939 (local address 127.10.75.65:46067)
0812 02:45:07.484998 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:07.485003 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:07.497525 (+ 12522us) server_negotiation.cc:407] Connection header received
0812 02:45:07.497755 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:07.497759 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:07.497816 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:07.497898 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:07.498251 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.498950 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.504469 (+ 5519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.505079 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.505216 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:07.505280 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:07.506286 (+ 1006us) server_negotiation.cc:299] Negotiation successful
0812 02:45:07.506392 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 02:45:07.507565 2258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c7b27ad72d34f469d2c2220cda5bc22" candidate_uuid: "fa617a56ad5b4fada53cc18664d1fc43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e4e65965fbe4819bfff62e0792a8abd" is_pre_election: true
I20260812 02:45:07.507944 2258 raft_consensus.cc:2454] T 7c7b27ad72d34f469d2c2220cda5bc22 P 4e4e65965fbe4819bfff62e0792a8abd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa617a56ad5b4fada53cc18664d1fc43 in term 0.
I20260812 02:45:07.508561 2396 leader_election.cc:302] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e4e65965fbe4819bfff62e0792a8abd, fa617a56ad5b4fada53cc18664d1fc43; no voters:
I20260812 02:45:07.508908 2917 raft_consensus.cc:2781] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:45:07.508988 2917 raft_consensus.cc:482] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:45:07.509032 2917 raft_consensus.cc:3037] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:07.510566 2917 raft_consensus.cc:504] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e4e65965fbe4819bfff62e0792a8abd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46067 } } peers { permanent_uuid: "fa617a56ad5b4fada53cc18664d1fc43" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45119 } } peers { permanent_uuid: "fd2d9135b8124cac9d9b5c9ad063072e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 36575 } }
I20260812 02:45:07.510960 2917 leader_election.cc:288] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [CANDIDATE]: Term 1 election: Requested vote from peers 4e4e65965fbe4819bfff62e0792a8abd (127.10.75.65:46067), fd2d9135b8124cac9d9b5c9ad063072e (127.10.75.67:36575)
I20260812 02:45:07.512713 2901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:07.484103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:36581 (local address 127.10.75.67:36575)
0812 02:45:07.484234 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:07.484238 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:07.487262 (+ 3024us) server_negotiation.cc:407] Connection header received
0812 02:45:07.487521 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:07.487527 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:07.487587 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:07.487639 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:07.496381 (+ 8742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.497122 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.511348 (+ 14226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.511950 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.512078 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:07.512130 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:07.512492 (+ 362us) server_negotiation.cc:299] Negotiation successful
0812 02:45:07.512585 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 02:45:07.512756 2916 raft_consensus.cc:482] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:45:07.512930 2916 raft_consensus.cc:504] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e4e65965fbe4819bfff62e0792a8abd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46067 } } peers { permanent_uuid: "fa617a56ad5b4fada53cc18664d1fc43" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45119 } } peers { permanent_uuid: "fd2d9135b8124cac9d9b5c9ad063072e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 36575 } }
I20260812 02:45:07.513168 2927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:07.483526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:36575 (local address 127.10.75.66:36581)
0812 02:45:07.487153 (+ 3627us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:07.487173 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:07.487366 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:07.494739 (+ 7373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:07.494742 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:07.494779 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:07.495447 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:07.495561 (+ 114us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.506482 (+ 10921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.506485 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:07.511174 (+ 4689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:07.511185 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.512236 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.512239 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:07.512341 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:07.512366 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 02:45:07.512918 (+ 552us) client_negotiation.cc:240] Negotiation successful
0812 02:45:07.513020 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3393,"thread_start_us":138,"threads_started":1}
I20260812 02:45:07.513813 2779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c7b27ad72d34f469d2c2220cda5bc22" candidate_uuid: "fa617a56ad5b4fada53cc18664d1fc43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd2d9135b8124cac9d9b5c9ad063072e" is_pre_election: true
I20260812 02:45:07.513809 2780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c7b27ad72d34f469d2c2220cda5bc22" candidate_uuid: "fa617a56ad5b4fada53cc18664d1fc43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd2d9135b8124cac9d9b5c9ad063072e"
I20260812 02:45:07.514035 2779 raft_consensus.cc:2454] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa617a56ad5b4fada53cc18664d1fc43 in term 0.
I20260812 02:45:07.514271 2916 leader_election.cc:288] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e4e65965fbe4819bfff62e0792a8abd (127.10.75.65:46067), fa617a56ad5b4fada53cc18664d1fc43 (127.10.75.66:45119)
I20260812 02:45:07.519102 2258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c7b27ad72d34f469d2c2220cda5bc22" candidate_uuid: "fa617a56ad5b4fada53cc18664d1fc43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e4e65965fbe4819bfff62e0792a8abd"
I20260812 02:45:07.519328 2258 raft_consensus.cc:3037] T 7c7b27ad72d34f469d2c2220cda5bc22 P 4e4e65965fbe4819bfff62e0792a8abd [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:07.520548 2258 raft_consensus.cc:2454] T 7c7b27ad72d34f469d2c2220cda5bc22 P 4e4e65965fbe4819bfff62e0792a8abd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa617a56ad5b4fada53cc18664d1fc43 in term 1.
I20260812 02:45:07.520979 2396 leader_election.cc:302] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e4e65965fbe4819bfff62e0792a8abd, fa617a56ad5b4fada53cc18664d1fc43; no voters: fd2d9135b8124cac9d9b5c9ad063072e
I20260812 02:45:07.521347 2917 raft_consensus.cc:2781] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:45:07.521598 2917 raft_consensus.cc:686] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [term 1 LEADER]: Becoming Leader. State: Replica: fa617a56ad5b4fada53cc18664d1fc43, State: Running, Role: LEADER
I20260812 02:45:07.521999 2917 consensus_queue.cc:237] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e4e65965fbe4819bfff62e0792a8abd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46067 } } peers { permanent_uuid: "fa617a56ad5b4fada53cc18664d1fc43" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45119 } } peers { permanent_uuid: "fd2d9135b8124cac9d9b5c9ad063072e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 36575 } }
I20260812 02:45:07.525563 1947 catalog_manager.cc:5495] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa617a56ad5b4fada53cc18664d1fc43 (127.10.75.66). New cstate: current_term: 1 leader_uuid: "fa617a56ad5b4fada53cc18664d1fc43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e4e65965fbe4819bfff62e0792a8abd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa617a56ad5b4fada53cc18664d1fc43" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd2d9135b8124cac9d9b5c9ad063072e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 36575 } health_report { overall_health: UNKNOWN } } }
I20260812 02:45:07.532274 2892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:07.515309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:57811 (local address 127.10.75.65:46067)
0812 02:45:07.515423 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:07.515427 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:07.522394 (+ 6967us) server_negotiation.cc:407] Connection header received
0812 02:45:07.522604 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:07.522607 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:07.522655 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:07.522703 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:07.523177 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.523895 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.530894 (+ 6999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.531502 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.531613 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:07.531669 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:07.532045 (+ 376us) server_negotiation.cc:299] Negotiation successful
0812 02:45:07.532135 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 02:45:07.532753 2929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:07.514588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:46067 (local address 127.10.75.67:57811)
0812 02:45:07.522284 (+ 7696us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:07.522302 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:07.522476 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:07.522862 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:07.522865 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:07.522887 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:07.523035 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:07.523042 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.524316 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.524319 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:07.525525 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:07.525538 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.531775 (+ 6237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.531779 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:07.531884 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:07.531908 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 02:45:07.532500 (+ 592us) client_negotiation.cc:240] Negotiation successful
0812 02:45:07.532594 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7600,"thread_start_us":121,"threads_started":1}
I20260812 02:45:07.533236 2258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c7b27ad72d34f469d2c2220cda5bc22" candidate_uuid: "fd2d9135b8124cac9d9b5c9ad063072e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e4e65965fbe4819bfff62e0792a8abd" is_pre_election: true
I20260812 02:45:07.533455 2258 raft_consensus.cc:2379] T 7c7b27ad72d34f469d2c2220cda5bc22 P 4e4e65965fbe4819bfff62e0792a8abd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd2d9135b8124cac9d9b5c9ad063072e in current term 1: Already voted for candidate fa617a56ad5b4fada53cc18664d1fc43 in this term.
I20260812 02:45:07.534667 2898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:07.515040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:43681 (local address 127.10.75.66:45119)
0812 02:45:07.515149 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:07.515153 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:07.524027 (+ 8874us) server_negotiation.cc:407] Connection header received
0812 02:45:07.524076 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:07.524078 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:07.524124 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:07.524196 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:07.525947 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.526625 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.533280 (+ 6655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.533875 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.533974 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:07.534038 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:07.534465 (+ 427us) server_negotiation.cc:299] Negotiation successful
0812 02:45:07.534549 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 02:45:07.535055 2928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:07.514961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:45119 (local address 127.10.75.67:43681)
0812 02:45:07.523317 (+ 8356us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:07.523330 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:07.523419 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:07.525668 (+ 2249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:07.525671 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:07.525693 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:07.525813 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:07.525819 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.529321 (+ 3502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.529324 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:07.530710 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:07.530726 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.534174 (+ 3448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.534177 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:07.534311 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:07.534335 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 02:45:07.534820 (+ 485us) client_negotiation.cc:240] Negotiation successful
0812 02:45:07.534904 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8289,"thread_start_us":99,"threads_started":1}
I20260812 02:45:07.535737 2516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c7b27ad72d34f469d2c2220cda5bc22" candidate_uuid: "fd2d9135b8124cac9d9b5c9ad063072e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa617a56ad5b4fada53cc18664d1fc43" is_pre_election: true
I20260812 02:45:07.536453 2635 leader_election.cc:302] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd2d9135b8124cac9d9b5c9ad063072e; no voters: 4e4e65965fbe4819bfff62e0792a8abd, fa617a56ad5b4fada53cc18664d1fc43
I20260812 02:45:07.536798 2916 raft_consensus.cc:3037] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:07.538322 2916 raft_consensus.cc:2726] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 02:45:07.647540 2898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:07.629816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35696 (local address 127.10.75.66:45119)
0812 02:45:07.629953 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:07.629957 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:07.638575 (+ 8618us) server_negotiation.cc:407] Connection header received
0812 02:45:07.642305 (+ 3730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:07.642310 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:07.642421 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:07.642529 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:45:07.643068 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.643874 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.645318 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:07.645671 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:07.645762 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:07.646332 (+ 570us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:45:07.646959 (+ 627us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:45:07.647081 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:07.647282 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 02:45:07.647353 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 02:45:07.655728 2780 raft_consensus.cc:1261] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e [term 1 FOLLOWER]: Refusing update from remote peer fa617a56ad5b4fada53cc18664d1fc43: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:45:07.656952 2930 consensus_queue.cc:1035] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd2d9135b8124cac9d9b5c9ad063072e" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 36575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:45:07.657145 2258 raft_consensus.cc:1261] T 7c7b27ad72d34f469d2c2220cda5bc22 P 4e4e65965fbe4819bfff62e0792a8abd [term 1 FOLLOWER]: Refusing update from remote peer fa617a56ad5b4fada53cc18664d1fc43: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:45:07.657725 2930 consensus_queue.cc:1035] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e4e65965fbe4819bfff62e0792a8abd" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 46067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:45:07.670288 2938 mvcc.cc:205] Tried to move back new op lower bound from 7317515090548871168 to 7317515090013339648. Current Snapshot: MvccSnapshot[applied={T|T < 7317515090548871168}]
I20260812 02:45:07.670872 2944 mvcc.cc:205] Tried to move back new op lower bound from 7317515090548871168 to 7317515090013339648. Current Snapshot: MvccSnapshot[applied={T|T < 7317515090548871168}]
I20260812 02:45:07.680994 1947 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:45:07.681205 1947 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:45:07.685225 1947 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2503915edd684ea885700aaea8837698: Sending DeleteTablet for 3 replicas of tablet 7c7b27ad72d34f469d2c2220cda5bc22
I20260812 02:45:07.686200 2740 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c7b27ad72d34f469d2c2220cda5bc22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:45:07 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:54822
I20260812 02:45:07.686933 2480 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c7b27ad72d34f469d2c2220cda5bc22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:45:07 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:35692
I20260812 02:45:07.687927 2959 tablet_replica.cc:330] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43: stopping tablet replica
I20260812 02:45:07.687878 2215 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c7b27ad72d34f469d2c2220cda5bc22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:45:07 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:60046
I20260812 02:45:07.688056 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 2032
I20260812 02:45:07.698571 2959 raft_consensus.cc:2229] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:45:07.699187 2959 raft_consensus.cc:2258] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:45:07.699637 2958 tablet_replica.cc:330] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e: stopping tablet replica
I20260812 02:45:07.700548 2958 raft_consensus.cc:2229] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:45:07.707477 2959 ts_tablet_manager.cc:1905] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:45:07.711275 2958 raft_consensus.cc:2258] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:45:07.711331 2959 ts_tablet_manager.cc:1918] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:45:07.711440 2959 log.cc:1196] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/7c7b27ad72d34f469d2c2220cda5bc22
I20260812 02:45:07.711983 2959 ts_tablet_manager.cc:1939] T 7c7b27ad72d34f469d2c2220cda5bc22 P fa617a56ad5b4fada53cc18664d1fc43: Deleting consensus metadata
I20260812 02:45:07.713660 2958 ts_tablet_manager.cc:1905] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:45:07.713973 1922 catalog_manager.cc:4841] TS fa617a56ad5b4fada53cc18664d1fc43 (127.10.75.66:45119): tablet 7c7b27ad72d34f469d2c2220cda5bc22 (table test-table [id=f50280c946964c63bb516da253b28943]) successfully deleted
I20260812 02:45:07.717027 2958 ts_tablet_manager.cc:1918] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:45:07.717127 2958 log.cc:1196] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/7c7b27ad72d34f469d2c2220cda5bc22
I20260812 02:45:07.717571 2958 ts_tablet_manager.cc:1939] T 7c7b27ad72d34f469d2c2220cda5bc22 P fd2d9135b8124cac9d9b5c9ad063072e: Deleting consensus metadata
W20260812 02:45:07.718014 1922 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.75.65:46067 (error 108)
I20260812 02:45:07.718896 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 2355
I20260812 02:45:07.719053 1921 catalog_manager.cc:4841] TS fd2d9135b8124cac9d9b5c9ad063072e (127.10.75.67:36575): tablet 7c7b27ad72d34f469d2c2220cda5bc22 (table test-table [id=f50280c946964c63bb516da253b28943]) successfully deleted
I20260812 02:45:07.748028 2971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:07.743185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:46067 (local address 127.0.0.1:60056)
0812 02:45:07.747714 (+ 4529us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:07.747820 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.65:46067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4430,"thread_start_us":1157,"threads_started":1}
W20260812 02:45:07.749447 1922 catalog_manager.cc:4584] TS 4e4e65965fbe4819bfff62e0792a8abd (127.10.75.65:46067): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7c7b27ad72d34f469d2c2220cda5bc22: Network error: Client connection negotiation failed: client connection to 127.10.75.65:46067: connect: Connection refused (error 111)
I20260812 02:45:07.754442 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 2607
I20260812 02:45:07.772713 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 1881
I20260812 02:45:07.795436 10541 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 02:45:08.149230 10541 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 02:45:08.149386 10541 mini_ranger.cc:66] Stopping Ranger...
I20260812 02:45:08.505823 10541 mini_ranger.cc:68] Stopped Ranger
2026-08-12 02:45:08.506 UTC [32540] LOG: received smart shutdown request
2026-08-12 02:45:08.511 UTC [32540] LOG: background worker "logical replication launcher" (PID 32562) exited with exit code 1
2026-08-12 02:45:08.512 UTC [32555] LOG: shutting down
2026-08-12 02:45:08.722 UTC [32540] LOG: database system is shut down
2026-08-12T02:45:08Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (50650 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:45:08 dist-test-slave-2p8l krb5kdc[2991](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:45:08 dist-test-slave-2p8l krb5kdc[2991](info): set up 2 sockets
Aug 12 02:45:08 dist-test-slave-2p8l krb5kdc[2991](info): commencing operation
krb5kdc: starting...
W20260812 02:45:10.202315 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.324s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:45:10 dist-test-slave-2p8l krb5kdc[2991](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:45:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:45:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:45:10.346309 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:37809
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:34289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:37809,127.10.75.125:37917,127.10.75.124:44111
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:45:10.464809 3014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:10.465190 3014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:10.465276 3014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:10.469498 3014 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:45:10.469635 3014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:10.469676 3014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:10.469717 3014 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:45:10.469753 3014 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:45:10.475608 3014 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:34289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:37809,127.10.75.125:37917,127.10.75.124:44111
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:37809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:10.476897 3014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:10.478025 3014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 02:45:10.487790 3014 server_base.cc:1034] running on GCE node
W20260812 02:45:10.487811 3028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:10.487986 3026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:10.487811 3031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:10.488790 3014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:10.490108 3014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:10.491315 3014 hybrid_clock.cc:648] HybridClock initialized: now 1786502710491265 us; error 70 us; skew 500 ppm
Aug 12 02:45:10 dist-test-slave-2p8l krb5kdc[2991](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502710, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:10.500309 3014 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:45:10.501493 3014 webserver.cc:460] Webserver started at http://127.10.75.126:44177/ using document root <none> and password file <none>
I20260812 02:45:10.502266 3014 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:10.502375 3014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:10.502640 3014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:45:10.505035 3014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "8ed77aed14fe4d93a4d43509aaba457b"
format_stamp: "Formatted at 2026-08-12 02:45:10 on dist-test-slave-2p8l"
server_key: "4552fc8fcf7ae304a6aa04e3727eeba9"
server_key_iv: "87de29ac64cd1985ae2a66a22260d724"
server_key_version: "encryptionkey@0"
I20260812 02:45:10.505694 3014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "8ed77aed14fe4d93a4d43509aaba457b"
format_stamp: "Formatted at 2026-08-12 02:45:10 on dist-test-slave-2p8l"
server_key: "4552fc8fcf7ae304a6aa04e3727eeba9"
server_key_iv: "87de29ac64cd1985ae2a66a22260d724"
server_key_version: "encryptionkey@0"
I20260812 02:45:10.509964 3014 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260812 02:45:10.513684 3046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:10.515102 3014 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:45:10.515306 3014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "8ed77aed14fe4d93a4d43509aaba457b"
format_stamp: "Formatted at 2026-08-12 02:45:10 on dist-test-slave-2p8l"
server_key: "4552fc8fcf7ae304a6aa04e3727eeba9"
server_key_iv: "87de29ac64cd1985ae2a66a22260d724"
server_key_version: "encryptionkey@0"
I20260812 02:45:10.515442 3014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:10.532681 3014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:10.536433 3014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:10.536681 3014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:10.544929 3014 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:37809
I20260812 02:45:10.544957 3149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:37809 every 8 connection(s)
I20260812 02:45:10.546002 3014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:45:10.549095 3152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:10.553388 3152 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } has no permanent_uuid. Determining permanent_uuid...
I20260812 02:45:10.554863 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 3014
I20260812 02:45:10.554977 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:45:10.555415 10541 external_mini_cluster.cc:1428] Setting key 6f78d6a5e550c92e8c802ec95854c183
Aug 12 02:45:10 dist-test-slave-2p8l krb5kdc[2991](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502710, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.75.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.125@KRBTEST.COM" created.
I20260812 02:45:10.571671 3155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.556011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37809 (local address 127.0.0.1:46332)
0812 02:45:10.556642 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.556715 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:10.557926 (+ 1211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:10.558877 (+ 951us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:10.558882 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:10.559407 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:10.559820 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:10.559844 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:10.561054 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:10.561059 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:10.562470 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:10.562487 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:10.563243 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:10.563252 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:10.563388 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:10.564104 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:10.564127 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:10.566022 (+ 1895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:10.568166 (+ 2144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:10.568176 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:10.568188 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:10.568576 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:10.568978 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:10.568984 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:10.568989 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:10.569129 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:10.569993 (+ 864us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:10.569999 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:10.570213 (+ 214us) client_negotiation.cc:769] Sending connection context
0812 02:45:10.570375 (+ 162us) client_negotiation.cc:240] Negotiation successful
0812 02:45:10.570733 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":155,"threads_started":1}
I20260812 02:45:10.571676 3156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.556855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46332 (local address 127.10.75.126:37809)
0812 02:45:10.557147 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:10.557157 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:10.557196 (+ 39us) server_negotiation.cc:407] Connection header received
0812 02:45:10.558342 (+ 1146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:10.558351 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:10.558633 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:10.558874 (+ 241us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:10.560002 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:10.560900 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:10.562611 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:10.563023 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:10.563154 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:10.566233 (+ 3079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:10.566240 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:10.566253 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:10.566275 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:10.568033 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:10.568713 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:10.568719 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:10.568720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:10.568841 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:10.569237 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:10.569241 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:10.569242 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:10.569842 (+ 600us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:10.569994 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:10.570519 (+ 525us) server_negotiation.cc:299] Negotiation successful
0812 02:45:10.570904 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":127,"server-negotiator.queue_time_us":182,"thread_start_us":106,"threads_started":1}
I20260812 02:45:10.574434 3152 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } has no permanent_uuid. Determining permanent_uuid...
I20260812 02:45:10.575541 3155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.575066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:37917 (local address 127.0.0.1:48042)
0812 02:45:10.575379 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.575465 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.125:37917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223}
W20260812 02:45:10.575812 3051 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.75.125:37917: connect: Connection refused (error 111)
I20260812 02:45:10.576856 3155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.576567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:37917 (local address 127.0.0.1:48052)
0812 02:45:10.576740 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.576796 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.125:37917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260812 02:45:10.577036 3152 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.125:37917: Network error: Client connection negotiation failed: client connection to 127.10.75.125:37917: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.125.keytab.
Entry for principal kudu/127.10.75.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.125.keytab.
I20260812 02:45:10.591260 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.125:37917
--webserver_interface=127.10.75.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.125.keytab
--principal=kudu/127.10.75.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:34289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:37809,127.10.75.125:37917,127.10.75.124:44111
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:45:10.626385 3152 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } attempt: 1
I20260812 02:45:10.627394 3155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.627069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:37917 (local address 127.0.0.1:48056)
0812 02:45:10.627240 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.627310 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.125:37917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260812 02:45:10.628202 3155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.627970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:37917 (local address 127.0.0.1:48062)
0812 02:45:10.628086 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.628144 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.125:37917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 02:45:10.628343 3152 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.125:37917: Network error: Client connection negotiation failed: client connection to 127.10.75.125:37917: connect: Connection refused (error 111)
I20260812 02:45:10.696547 3152 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } attempt: 2
I20260812 02:45:10.697537 3155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.697208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:37917 (local address 127.0.0.1:48064)
0812 02:45:10.697385 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.697453 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.125:37917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260812 02:45:10.698421 3155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.698169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:37917 (local address 127.0.0.1:48080)
0812 02:45:10.698283 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.698360 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.125:37917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260812 02:45:10.698561 3152 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.125:37917: Network error: Client connection negotiation failed: client connection to 127.10.75.125:37917: connect: Connection refused (error 111)
W20260812 02:45:10.714674 3164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:10.715003 3164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:10.715111 3164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:10.719390 3164 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:45:10.719482 3164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:10.719521 3164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:10.719578 3164 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:45:10.719616 3164 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:45:10.725291 3164 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:34289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:37809,127.10.75.125:37917,127.10.75.124:44111
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.125.keytab
--principal=kudu/127.10.75.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.125:37917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.75.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:10.726596 3164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:10.727663 3164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:10.736449 3170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:10.736624 3164 server_base.cc:1034] running on GCE node
W20260812 02:45:10.736474 3174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:10.736451 3177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:10.737485 3164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:10.738765 3164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:10.739962 3164 hybrid_clock.cc:648] HybridClock initialized: now 1786502710739945 us; error 27 us; skew 500 ppm
Aug 12 02:45:10 dist-test-slave-2p8l krb5kdc[2991](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502710, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:10.743063 3164 init.cc:377] Logged in from keytab as kudu/127.10.75.125@KRBTEST.COM (short username kudu)
I20260812 02:45:10.744078 3164 webserver.cc:460] Webserver started at http://127.10.75.125:46139/ using document root <none> and password file <none>
I20260812 02:45:10.744702 3164 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:10.744812 3164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:10.745064 3164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:45:10.747339 3164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-1/data/instance:
uuid: "494765ea4cd94973b2f121cbc075a16d"
format_stamp: "Formatted at 2026-08-12 02:45:10 on dist-test-slave-2p8l"
server_key: "befbe7bdaf6718dd9e1d7bd7b73541e8"
server_key_iv: "2b98bb5b53d03b35660cef0ba965c288"
server_key_version: "encryptionkey@0"
I20260812 02:45:10.747957 3164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-1/wal/instance:
uuid: "494765ea4cd94973b2f121cbc075a16d"
format_stamp: "Formatted at 2026-08-12 02:45:10 on dist-test-slave-2p8l"
server_key: "befbe7bdaf6718dd9e1d7bd7b73541e8"
server_key_iv: "2b98bb5b53d03b35660cef0ba965c288"
server_key_version: "encryptionkey@0"
I20260812 02:45:10.752367 3164 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 02:45:10.755314 3188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:10.756603 3164 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:45:10.756842 3164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-1/wal
uuid: "494765ea4cd94973b2f121cbc075a16d"
format_stamp: "Formatted at 2026-08-12 02:45:10 on dist-test-slave-2p8l"
server_key: "befbe7bdaf6718dd9e1d7bd7b73541e8"
server_key_iv: "2b98bb5b53d03b35660cef0ba965c288"
server_key_version: "encryptionkey@0"
I20260812 02:45:10.756981 3164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:10.766583 3164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:10.770032 3164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:10.770280 3164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:10.777799 3164 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.125:37917
I20260812 02:45:10.777829 3281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.125:37917 every 8 connection(s)
I20260812 02:45:10.778822 3164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-1/data/info.pb
I20260812 02:45:10.779582 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 3164
I20260812 02:45:10.779709 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-1/wal/instance
I20260812 02:45:10.780009 10541 external_mini_cluster.cc:1428] Setting key 94d1cd97854d32f7b43751fd9d1f6bc2
I20260812 02:45:10.782557 3285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:10.786643 3285 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.10.75.124@KRBTEST.COM; defaulting to no policy
I20260812 02:45:10.789747 3152 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } attempt: 3
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.124@KRBTEST.COM" created.
Aug 12 02:45:10 dist-test-slave-2p8l krb5kdc[2991](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502710, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for kudu/127.10.75.125@KRBTEST.COM
Aug 12 02:45:10 dist-test-slave-2p8l krb5kdc[2991](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502710, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.125@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:10.802670 3155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.790199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:37917 (local address 127.0.0.1:48082)
0812 02:45:10.790342 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.790359 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:10.790454 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:10.791366 (+ 912us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:10.791369 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:10.791571 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:10.791703 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:10.791711 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:10.793366 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:10.793372 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:10.794305 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:10.794320 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:10.795076 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:10.795080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:10.795190 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:10.795872 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:10.795884 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:10.797600 (+ 1716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:10.800416 (+ 2816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:10.800422 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:10.800425 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:10.800716 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:10.801172 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:10.801175 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:10.801177 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:10.801274 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:10.801954 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:10.801958 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:10.802114 (+ 156us) client_negotiation.cc:769] Sending connection context
0812 02:45:10.802240 (+ 126us) client_negotiation.cc:240] Negotiation successful
0812 02:45:10.802426 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 02:45:10.803241 3156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.788805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46342 (local address 127.10.75.126:37809)
0812 02:45:10.788950 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:10.788954 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:10.790108 (+ 1154us) server_negotiation.cc:407] Connection header received
0812 02:45:10.791198 (+ 1090us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:10.791201 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:10.791359 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:10.791478 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:10.792472 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:10.793123 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:10.794212 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:10.794544 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:10.794650 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:10.798433 (+ 3783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:10.798440 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:10.798443 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:10.798473 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:10.800328 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:10.800806 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:10.800810 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:10.800812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:10.800900 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:10.801294 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:10.801298 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:10.801301 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:10.801570 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:10.801695 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:10.802908 (+ 1213us) server_negotiation.cc:299] Negotiation successful
0812 02:45:10.803093 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 02:45:10.803674 3290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.789308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37809 (local address 127.0.0.1:46342)
0812 02:45:10.789847 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.789964 (+ 117us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:10.790981 (+ 1017us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:10.791573 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:10.791579 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:10.792011 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:10.792331 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:10.792345 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:10.793269 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:10.793274 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:10.794040 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:10.794050 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:10.794744 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:10.794750 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:10.795014 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:10.795732 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:10.795758 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:10.797929 (+ 2171us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:10.800450 (+ 2521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:10.800458 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:10.800466 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:10.800688 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:10.800998 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:10.801002 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:10.801003 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:10.801163 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:10.801710 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:10.801716 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:10.801854 (+ 138us) client_negotiation.cc:769] Sending connection context
0812 02:45:10.802045 (+ 191us) client_negotiation.cc:240] Negotiation successful
0812 02:45:10.802496 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":19,"spinlock_wait_cycles":5504,"thread_start_us":133,"threads_started":1}
I20260812 02:45:10.803697 3292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.790423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48082 (local address 127.10.75.125:37917)
0812 02:45:10.790820 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:10.790829 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:10.790879 (+ 50us) server_negotiation.cc:407] Connection header received
0812 02:45:10.791001 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:10.791016 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:10.791200 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:10.791393 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:10.791872 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:10.793171 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:10.794439 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:10.794941 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:10.795068 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:10.797780 (+ 2712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:10.797786 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:10.797799 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:10.797822 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:10.800275 (+ 2453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:10.800863 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:10.800873 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:10.800878 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:10.801053 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:10.801352 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:10.801357 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:10.801359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:10.801823 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:10.801958 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:10.803394 (+ 1436us) server_negotiation.cc:299] Negotiation successful
0812 02:45:10.803553 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":297,"spinlock_wait_cycles":12288,"thread_start_us":206,"threads_started":1}
I20260812 02:45:10.805990 3285 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } has no permanent_uuid. Determining permanent_uuid...
I20260812 02:45:10.806044 3152 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } has no permanent_uuid. Determining permanent_uuid...
I20260812 02:45:10.806830 3155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.806514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44111 (local address 127.0.0.1:52138)
0812 02:45:10.806674 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.806726 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 02:45:10.807788 3155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.807503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44111 (local address 127.0.0.1:52140)
0812 02:45:10.807682 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.807730 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
W20260812 02:45:10.808037 3152 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:44111: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
Aug 12 02:45:10 dist-test-slave-2p8l krb5kdc[2991](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502710, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.125@KRBTEST.COM for kudu/127.10.75.125@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.124.keytab.
Entry for principal kudu/127.10.75.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.124.keytab.
I20260812 02:45:10.813988 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.124:44111
--webserver_interface=127.10.75.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.124.keytab
--principal=kudu/127.10.75.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:34289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:37809,127.10.75.125:37917,127.10.75.124:44111
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:45:10.815274 3292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.806909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48084 (local address 127.10.75.125:37917)
0812 02:45:10.807032 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:10.807039 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:10.807058 (+ 19us) server_negotiation.cc:407] Connection header received
0812 02:45:10.807209 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:10.807212 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:10.807258 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:10.807399 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:10.807883 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:10.808581 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:10.809340 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:10.809591 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:10.809735 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:10.811829 (+ 2094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:10.811832 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:10.811834 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:10.811857 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:10.813276 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:10.813856 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:10.813859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:10.813860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:10.813947 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:10.814409 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:10.814415 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:10.814416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:10.814600 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:10.814722 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:10.814974 (+ 252us) server_negotiation.cc:299] Negotiation successful
0812 02:45:10.815125 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":44}
I20260812 02:45:10.815274 3290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.806797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:37917 (local address 127.0.0.1:48084)
0812 02:45:10.806989 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.807022 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:10.807103 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:10.807401 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:10.807407 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:10.807591 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:10.807735 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:10.807743 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:10.808689 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:10.808692 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:10.809214 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:10.809222 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:10.809705 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:10.809708 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:10.809842 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:10.810406 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:10.810417 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:10.811684 (+ 1267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:10.813391 (+ 1707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:10.813397 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:10.813400 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:10.813593 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:10.814188 (+ 595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:10.814192 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:10.814194 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:10.814300 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:10.814712 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:10.814715 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:10.814812 (+ 97us) client_negotiation.cc:769] Sending connection context
0812 02:45:10.814917 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 02:45:10.815070 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":21}
I20260812 02:45:10.816185 3285 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } has no permanent_uuid. Determining permanent_uuid...
I20260812 02:45:10.816927 3290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.816665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44111 (local address 127.0.0.1:52148)
0812 02:45:10.816793 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.816870 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 02:45:10.817778 3191 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
I20260812 02:45:10.818847 3290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.818544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44111 (local address 127.0.0.1:52150)
0812 02:45:10.818698 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.818762 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 02:45:10.819123 3285 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:44111: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
I20260812 02:45:10.839226 3152 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } attempt: 1
I20260812 02:45:10.840287 3155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.839936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44111 (local address 127.0.0.1:52152)
0812 02:45:10.840120 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.840197 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260812 02:45:10.841086 3155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.840878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44111 (local address 127.0.0.1:52164)
0812 02:45:10.840982 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.841034 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 02:45:10.841302 3152 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:44111: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
I20260812 02:45:10.868443 3285 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } attempt: 1
I20260812 02:45:10.869444 3290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.869104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44111 (local address 127.0.0.1:52166)
0812 02:45:10.869287 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.869352 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260812 02:45:10.870398 3290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.870099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44111 (local address 127.0.0.1:52172)
0812 02:45:10.870241 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.870302 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260812 02:45:10.870591 3285 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:44111: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
I20260812 02:45:10.916495 3152 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } attempt: 2
I20260812 02:45:10.917515 3155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.917189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44111 (local address 127.0.0.1:52182)
0812 02:45:10.917368 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.917432 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260812 02:45:10.918303 3155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.918092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44111 (local address 127.0.0.1:52184)
0812 02:45:10.918204 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.918249 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 02:45:10.918447 3152 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:44111: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
I20260812 02:45:10.938791 3285 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } attempt: 2
W20260812 02:45:10.938557 3296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:10.938983 3296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:10.939045 3296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 02:45:10.939718 3290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.939377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44111 (local address 127.0.0.1:52200)
0812 02:45:10.939554 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.939622 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 02:45:10.940465 3290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:10.940262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44111 (local address 127.0.0.1:52212)
0812 02:45:10.940362 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:10.940409 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 02:45:10.940640 3285 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:44111: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
W20260812 02:45:10.943835 3296 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:45:10.943919 3296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:10.943955 3296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:10.944012 3296 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:45:10.944051 3296 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:45:10.949749 3296 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:34289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:37809,127.10.75.125:37917,127.10.75.124:44111
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.124.keytab
--principal=kudu/127.10.75.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.124:44111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.75.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:10.951068 3296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:10.952150 3296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:10.961024 3309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:10.961113 3314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:10.961119 3310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:10.961453 3296 server_base.cc:1034] running on GCE node
I20260812 02:45:10.962209 3296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:10.963413 3296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:10.964579 3296 hybrid_clock.cc:648] HybridClock initialized: now 1786502710964568 us; error 29 us; skew 500 ppm
Aug 12 02:45:10 dist-test-slave-2p8l krb5kdc[2991](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502710, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:10.967576 3296 init.cc:377] Logged in from keytab as kudu/127.10.75.124@KRBTEST.COM (short username kudu)
I20260812 02:45:10.968583 3296 webserver.cc:460] Webserver started at http://127.10.75.124:42033/ using document root <none> and password file <none>
I20260812 02:45:10.969189 3296 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:10.969288 3296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:10.969533 3296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:45:10.971773 3296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-2/data/instance:
uuid: "8403dd425a424a5b82236e5e3b802fad"
format_stamp: "Formatted at 2026-08-12 02:45:10 on dist-test-slave-2p8l"
server_key: "062d20bedf796995cdda0b92754bfab9"
server_key_iv: "3040ae728f8b30fc37fffd35881e08c0"
server_key_version: "encryptionkey@0"
I20260812 02:45:10.972406 3296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-2/wal/instance:
uuid: "8403dd425a424a5b82236e5e3b802fad"
format_stamp: "Formatted at 2026-08-12 02:45:10 on dist-test-slave-2p8l"
server_key: "062d20bedf796995cdda0b92754bfab9"
server_key_iv: "3040ae728f8b30fc37fffd35881e08c0"
server_key_version: "encryptionkey@0"
I20260812 02:45:10.976383 3296 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 02:45:10.979054 3326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:10.980659 3296 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:45:10.980824 3296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-2/wal
uuid: "8403dd425a424a5b82236e5e3b802fad"
format_stamp: "Formatted at 2026-08-12 02:45:10 on dist-test-slave-2p8l"
server_key: "062d20bedf796995cdda0b92754bfab9"
server_key_iv: "3040ae728f8b30fc37fffd35881e08c0"
server_key_version: "encryptionkey@0"
I20260812 02:45:10.980940 3296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:11.008500 3296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:11.012468 3296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:11.012701 3296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:11.017622 3152 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } attempt: 3
I20260812 02:45:11.018756 3155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:11.018380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44111 (local address 127.0.0.1:52220)
0812 02:45:11.018518 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:11.018628 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 02:45:11.019742 3155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:11.019358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44111 (local address 127.0.0.1:52232)
0812 02:45:11.019555 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:11.019627 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
W20260812 02:45:11.019979 3152 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:44111: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44111: connect: Connection refused (error 111)
I20260812 02:45:11.021328 3296 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.124:44111
I20260812 02:45:11.021344 3416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.124:44111 every 8 connection(s)
I20260812 02:45:11.022477 3296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-2/data/info.pb
I20260812 02:45:11.024163 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 3296
I20260812 02:45:11.024302 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786502539688512-10541-0/minicluster-data/master-2/wal/instance
I20260812 02:45:11.024595 10541 external_mini_cluster.cc:1428] Setting key 2c070a94f55343bfe7f021b85f61d093
I20260812 02:45:11.025714 3417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:11.029917 3417 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } has no permanent_uuid. Determining permanent_uuid...
I20260812 02:45:11.031809 3285 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } attempt: 3
Aug 12 02:45:11 dist-test-slave-2p8l krb5kdc[2991](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.124@KRBTEST.COM
Aug 12 02:45:11 dist-test-slave-2p8l krb5kdc[2991](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502710, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.125@KRBTEST.COM for kudu/127.10.75.124@KRBTEST.COM
Aug 12 02:45:11 dist-test-slave-2p8l krb5kdc[2991](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502710, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.124@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:11.042871 3425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:11.026117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52242 (local address 127.10.75.124:44111)
0812 02:45:11.026681 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:11.026700 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:11.026743 (+ 43us) server_negotiation.cc:407] Connection header received
0812 02:45:11.027460 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:11.027478 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:11.027882 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:11.028345 (+ 463us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:11.029268 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.030517 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.031512 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.032240 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.032432 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:11.035740 (+ 3308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:11.035750 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:11.035766 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:11.035809 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:11.038798 (+ 2989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.039388 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.039395 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.039403 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.039587 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.039986 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.039989 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.039990 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.040626 (+ 636us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:11.040960 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:11.041223 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 02:45:11.041651 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":154,"threads_started":1}
I20260812 02:45:11.044606 3156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:11.032195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46350 (local address 127.10.75.126:37809)
0812 02:45:11.032367 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:11.032372 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:11.033061 (+ 689us) server_negotiation.cc:407] Connection header received
0812 02:45:11.033290 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:11.033292 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:11.033337 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:11.033522 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:11.034389 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.035058 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.036374 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.036701 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.036818 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:11.040261 (+ 3443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:11.040265 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:11.040268 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:11.040299 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:11.042532 (+ 2233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.043112 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.043115 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.043117 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.043236 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.043556 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.043560 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.043561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.043811 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:11.043916 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:11.044288 (+ 372us) server_negotiation.cc:299] Negotiation successful
0812 02:45:11.044419 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 02:45:11.044618 3426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:11.031874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37809 (local address 127.0.0.1:46350)
0812 02:45:11.032902 (+ 1028us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:11.032961 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:11.033095 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:11.033572 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:11.033578 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:11.034008 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:11.034220 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:11.034226 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.035198 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.035202 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:11.036210 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:11.036221 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.036826 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.036828 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:11.036917 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:11.037623 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:11.037654 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:11.040121 (+ 2467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:11.042659 (+ 2538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:11.042671 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:11.042679 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:11.042977 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:11.043359 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:11.043362 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:11.043364 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:11.043471 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:11.043932 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:11.043938 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:11.044058 (+ 120us) client_negotiation.cc:769] Sending connection context
0812 02:45:11.044224 (+ 166us) client_negotiation.cc:240] Negotiation successful
0812 02:45:11.044419 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":837,"thread_start_us":184,"threads_started":1}
I20260812 02:45:11.044624 3290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:11.032300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44111 (local address 127.0.0.1:52258)
0812 02:45:11.032560 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:11.032577 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:11.032671 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:11.034486 (+ 1815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:11.034489 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:11.034699 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:11.034824 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:11.034831 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.035828 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.035832 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:11.036564 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:11.036576 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.037235 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.037240 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:11.037348 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:11.037763 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:11.037781 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:11.039423 (+ 1642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:11.042920 (+ 3497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:11.042927 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:11.042931 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:11.043205 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:11.043501 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:11.043508 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:11.043512 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:11.043611 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:11.044056 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:11.044061 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:11.044182 (+ 121us) client_negotiation.cc:769] Sending connection context
0812 02:45:11.044292 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 02:45:11.044445 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179}
I20260812 02:45:11.045286 3428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:11.032822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52258 (local address 127.10.75.124:44111)
0812 02:45:11.034149 (+ 1327us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:11.034167 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:11.034188 (+ 21us) server_negotiation.cc:407] Connection header received
0812 02:45:11.034237 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:11.034244 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:11.034303 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:11.034429 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:11.034960 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.035696 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.036689 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.037104 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.037229 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:11.039584 (+ 2355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:11.039587 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:11.039591 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:11.039615 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:11.042787 (+ 3172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.043296 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.043300 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.043301 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.043391 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.043722 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.043725 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.043727 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.043946 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:11.044044 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:11.044966 (+ 922us) server_negotiation.cc:299] Negotiation successful
0812 02:45:11.045090 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":108,"threads_started":1}
I20260812 02:45:11.049242 3285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d: Bootstrap starting.
I20260812 02:45:11.046692 3417 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } has no permanent_uuid. Determining permanent_uuid...
I20260812 02:45:11.053258 3285 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d: Neither blocks nor log segments found. Creating new log.
Aug 12 02:45:11 dist-test-slave-2p8l krb5kdc[2991](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:11.054502 3285 log.cc:824] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d: Log is configured to *not* fsync() on all Append() calls
Aug 12 02:45:11 dist-test-slave-2p8l krb5kdc[2991](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502710, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.124@KRBTEST.COM for kudu/127.10.75.125@KRBTEST.COM
I20260812 02:45:11.058034 3285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d: No bootstrap required, opened a new log
I20260812 02:45:11.058372 3156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:11.046509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46356 (local address 127.10.75.126:37809)
0812 02:45:11.046651 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:11.046656 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:11.046782 (+ 126us) server_negotiation.cc:407] Connection header received
0812 02:45:11.046915 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:11.046918 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:11.046972 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:11.047053 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:11.048190 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.049071 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.050472 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.050935 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.051046 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:11.054504 (+ 3458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:11.054509 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:11.054512 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:11.054543 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:11.056525 (+ 1982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.057012 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.057016 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.057018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.057116 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.057430 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.057434 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.057435 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.057638 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:11.057897 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:11.058017 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 02:45:11.058187 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 02:45:11.062665 3426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:11.051248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:37917 (local address 127.0.0.1:48094)
0812 02:45:11.051509 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:11.051528 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:11.051740 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:11.052333 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:11.052335 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:11.052632 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:11.052826 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:11.052835 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.054333 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.054339 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:11.055185 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:11.055200 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.055866 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.055870 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:11.056001 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:11.056523 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:11.056538 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:11.058502 (+ 1964us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:11.060792 (+ 2290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:11.060795 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:11.060797 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:11.061034 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:11.061376 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:11.061382 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:11.061386 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:11.061489 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:11.062044 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:11.062047 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:11.062190 (+ 143us) client_negotiation.cc:769] Sending connection context
0812 02:45:11.062307 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 02:45:11.062477 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164}
I20260812 02:45:11.062680 3292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:11.050896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48094 (local address 127.10.75.125:37917)
0812 02:45:11.051091 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:11.051096 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:11.051625 (+ 529us) server_negotiation.cc:407] Connection header received
0812 02:45:11.051959 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:11.051962 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:11.052039 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:11.052121 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:11.053019 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.054105 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.055334 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.055718 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.055851 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:11.058653 (+ 2802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:11.058657 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:11.058660 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:11.058690 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:11.060619 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.061152 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.061156 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.061158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.061251 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.061629 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.061634 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.061636 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.061919 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:11.062047 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:11.062376 (+ 329us) server_negotiation.cc:299] Negotiation successful
0812 02:45:11.062493 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260812 02:45:11.062502 3285 raft_consensus.cc:348] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } } peers { permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } } peers { permanent_uuid: "8403dd425a424a5b82236e5e3b802fad" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } }
I20260812 02:45:11.062783 3285 raft_consensus.cc:374] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:11.062860 3285 raft_consensus.cc:729] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 494765ea4cd94973b2f121cbc075a16d, State: Initialized, Role: FOLLOWER
I20260812 02:45:11.063467 3417 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } has no permanent_uuid. Determining permanent_uuid...
I20260812 02:45:11.063431 3285 consensus_queue.cc:260] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } } peers { permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } } peers { permanent_uuid: "8403dd425a424a5b82236e5e3b802fad" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } }
I20260812 02:45:11.064851 3285 sys_catalog.cc:564] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:45:11.066151 3433 sys_catalog.cc:455] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } } peers { permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } } peers { permanent_uuid: "8403dd425a424a5b82236e5e3b802fad" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } } }
I20260812 02:45:11.066406 3433 sys_catalog.cc:458] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d [sys.catalog]: This master's current role is: FOLLOWER
Aug 12 02:45:11 dist-test-slave-2p8l krb5kdc[2991](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.125@KRBTEST.COM
Aug 12 02:45:11 dist-test-slave-2p8l krb5kdc[2991](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502710, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.124@KRBTEST.COM for kudu/127.10.75.124@KRBTEST.COM
W20260812 02:45:11.072036 3456 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:45:11.072208 3456 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:45:11.069198 3164 master_runner.cc:186] Error getting master registration for 127.10.75.126:37809: OK, instance_id { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" instance_seqno: 1786502710542476 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 02:45:11.073589 3164 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 02:45:11.074451 3432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:11.060242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48096 (local address 127.10.75.125:37917)
0812 02:45:11.060557 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:11.060565 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:11.060581 (+ 16us) server_negotiation.cc:407] Connection header received
0812 02:45:11.060617 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:11.060619 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:11.060701 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:11.060796 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:11.061982 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.063791 (+ 1809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.064960 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.065302 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.065419 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:11.070023 (+ 4604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:11.070028 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:11.070034 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:11.070067 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:11.072340 (+ 2273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.072940 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.072944 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.072946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.073047 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.073383 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.073387 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.073389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.073635 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:11.073833 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:11.074106 (+ 273us) server_negotiation.cc:299] Negotiation successful
0812 02:45:11.074259 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":132,"threads_started":1}
I20260812 02:45:11.074491 3426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:11.064014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44111 (local address 127.0.0.1:52268)
0812 02:45:11.064300 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:11.064313 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:11.064387 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:11.064702 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:11.064704 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:11.064895 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:11.065010 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:11.065017 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.065913 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.065919 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:11.066684 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:11.066695 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.067389 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.067394 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:11.067486 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:11.068177 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:11.068197 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:11.069678 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:11.072501 (+ 2823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:11.072504 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:11.072506 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:11.072751 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:11.073087 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:11.073091 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:11.073102 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:11.073214 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:11.073876 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:11.073879 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:11.073980 (+ 101us) client_negotiation.cc:769] Sending connection context
0812 02:45:11.074124 (+ 144us) client_negotiation.cc:240] Negotiation successful
0812 02:45:11.074279 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215}
I20260812 02:45:11.074955 3425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:11.064198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52268 (local address 127.10.75.124:44111)
0812 02:45:11.064523 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:11.064527 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:11.064537 (+ 10us) server_negotiation.cc:407] Connection header received
0812 02:45:11.064564 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:11.064566 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:11.064601 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:11.065103 (+ 502us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:11.065158 (+ 55us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.065812 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.066807 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.067152 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.067261 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:11.069833 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:11.069837 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:11.069840 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:11.069863 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:11.072340 (+ 2477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.072867 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.072873 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.072875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.072966 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.073340 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.073346 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.073349 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.073731 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:11.073839 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:11.074729 (+ 890us) server_negotiation.cc:299] Negotiation successful
0812 02:45:11.074847 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254}
I20260812 02:45:11.078569 3417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad: Bootstrap starting.
I20260812 02:45:11.078653 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:45:11.081697 3417 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:11.082792 3417 log.cc:824] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:11.093241 3156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:11.082012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46364 (local address 127.10.75.126:37809)
0812 02:45:11.082197 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:11.082203 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:11.082236 (+ 33us) server_negotiation.cc:407] Connection header received
0812 02:45:11.082293 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:11.082298 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:11.082354 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:11.082446 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:11.083661 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.084648 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.085714 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.086155 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.086292 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:11.088308 (+ 2016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:11.088312 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:11.088316 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:11.088350 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:11.090823 (+ 2473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.091397 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.091401 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.091403 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.091534 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.091929 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.091934 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.091936 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.092250 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:11.092387 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:11.092859 (+ 472us) server_negotiation.cc:299] Negotiation successful
0812 02:45:11.093017 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260812 02:45:11.094913 3432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:11.082927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48110 (local address 127.10.75.125:37917)
0812 02:45:11.083064 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:11.083068 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:11.083563 (+ 495us) server_negotiation.cc:407] Connection header received
0812 02:45:11.083706 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:11.083710 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:11.083761 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:11.083851 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:11.084790 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.085757 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.087342 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.087711 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.087795 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:11.090303 (+ 2508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:11.090308 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:11.090311 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:11.090340 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:11.092545 (+ 2205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.093044 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.093048 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.093050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.093136 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.093800 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.093804 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.093806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.094024 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:11.094183 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:11.094605 (+ 422us) server_negotiation.cc:299] Negotiation successful
0812 02:45:11.094745 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 02:45:11.095319 3425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:11.082234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52284 (local address 127.10.75.124:44111)
0812 02:45:11.082365 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:11.082369 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:11.082383 (+ 14us) server_negotiation.cc:407] Connection header received
0812 02:45:11.082429 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:11.082435 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:11.082479 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:11.082554 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:11.086780 (+ 4226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.087584 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.088821 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.089081 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.089226 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:11.090988 (+ 1762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:11.090995 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:11.091002 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:11.091037 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:11.092877 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.093531 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.093535 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.093537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.093638 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.094009 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.094013 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.094015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.094326 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:11.094441 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:11.094852 (+ 411us) server_negotiation.cc:299] Negotiation successful
0812 02:45:11.094992 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 02:45:11.096496 3417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad: No bootstrap required, opened a new log
I20260812 02:45:11.099941 3417 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } } peers { permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } } peers { permanent_uuid: "8403dd425a424a5b82236e5e3b802fad" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } }
I20260812 02:45:11.100381 3417 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:11.100505 3417 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8403dd425a424a5b82236e5e3b802fad, State: Initialized, Role: FOLLOWER
I20260812 02:45:11.101130 3417 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } } peers { permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } } peers { permanent_uuid: "8403dd425a424a5b82236e5e3b802fad" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } }
I20260812 02:45:11.101787 3475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } } peers { permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } } peers { permanent_uuid: "8403dd425a424a5b82236e5e3b802fad" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } } }
I20260812 02:45:11.101926 3475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:45:11.102821 3417 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [sys.catalog]: configured and running, proceeding with master startup.
W20260812 02:45:11.108305 3497 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:45:11.108472 3497 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:45:11.106618 3296 master_runner.cc:186] Error getting master registration for 127.10.75.126:37809: OK, instance_id { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" instance_seqno: 1786502710542476 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 02:45:11.110038 3296 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 02:45:11.121301 3475 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:45:11.121524 3475 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } } peers { permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } } peers { permanent_uuid: "8403dd425a424a5b82236e5e3b802fad" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } }
I20260812 02:45:11.122715 3475 leader_election.cc:288] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ed77aed14fe4d93a4d43509aaba457b (127.10.75.126:37809), 494765ea4cd94973b2f121cbc075a16d (127.10.75.125:37917)
I20260812 02:45:11.123505 3225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8403dd425a424a5b82236e5e3b802fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "494765ea4cd94973b2f121cbc075a16d" is_pre_election: true
I20260812 02:45:11.123871 3225 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8403dd425a424a5b82236e5e3b802fad in term 0.
I20260812 02:45:11.124363 3333 leader_election.cc:302] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 494765ea4cd94973b2f121cbc075a16d, 8403dd425a424a5b82236e5e3b802fad; no voters:
I20260812 02:45:11.124698 3475 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:45:11.124809 3475 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:45:11.124859 3475 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:11.126333 3475 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } } peers { permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } } peers { permanent_uuid: "8403dd425a424a5b82236e5e3b802fad" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } }
I20260812 02:45:11.128211 3475 leader_election.cc:288] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [CANDIDATE]: Term 1 election: Requested vote from peers 8ed77aed14fe4d93a4d43509aaba457b (127.10.75.126:37809), 494765ea4cd94973b2f121cbc075a16d (127.10.75.125:37917)
I20260812 02:45:11.128778 3225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8403dd425a424a5b82236e5e3b802fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "494765ea4cd94973b2f121cbc075a16d"
I20260812 02:45:11.128919 3225 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:11.130429 3225 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8403dd425a424a5b82236e5e3b802fad in term 1.
I20260812 02:45:11.130792 3333 leader_election.cc:302] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 494765ea4cd94973b2f121cbc075a16d, 8403dd425a424a5b82236e5e3b802fad; no voters:
I20260812 02:45:11.131021 3475 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:45:11.131568 3475 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [term 1 LEADER]: Becoming Leader. State: Replica: 8403dd425a424a5b82236e5e3b802fad, State: Running, Role: LEADER
I20260812 02:45:11.132385 3475 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } } peers { permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } } peers { permanent_uuid: "8403dd425a424a5b82236e5e3b802fad" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } }
I20260812 02:45:11.138586 3500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8403dd425a424a5b82236e5e3b802fad. Latest consensus state: current_term: 1 leader_uuid: "8403dd425a424a5b82236e5e3b802fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } } peers { permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } } peers { permanent_uuid: "8403dd425a424a5b82236e5e3b802fad" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } } }
I20260812 02:45:11.138970 3500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [sys.catalog]: This master's current role is: LEADER
I20260812 02:45:11.139839 3503 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:45:11.142835 3503 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:45:11.151875 3225 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d [term 1 FOLLOWER]: Refusing update from remote peer 8403dd425a424a5b82236e5e3b802fad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:45:11.152912 3500 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:45:11.157958 3433 sys_catalog.cc:455] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8403dd425a424a5b82236e5e3b802fad. Latest consensus state: current_term: 1 leader_uuid: "8403dd425a424a5b82236e5e3b802fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } } peers { permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } } peers { permanent_uuid: "8403dd425a424a5b82236e5e3b802fad" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } } }
I20260812 02:45:11.158135 3433 sys_catalog.cc:458] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:45:11.161123 3500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8403dd425a424a5b82236e5e3b802fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } } peers { permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } } peers { permanent_uuid: "8403dd425a424a5b82236e5e3b802fad" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } } }
I20260812 02:45:11.161276 3500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [sys.catalog]: This master's current role is: LEADER
I20260812 02:45:11.161404 3504 mvcc.cc:205] Tried to move back new op lower bound from 7317515104870473728 to 7317515104805564416. Current Snapshot: MvccSnapshot[applied={T|T < 7317515104870473728}]
I20260812 02:45:11.162588 3433 sys_catalog.cc:455] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8403dd425a424a5b82236e5e3b802fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } } peers { permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } } peers { permanent_uuid: "8403dd425a424a5b82236e5e3b802fad" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } } }
I20260812 02:45:11.162720 3433 sys_catalog.cc:458] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:45:11.164844 3507 mvcc.cc:205] Tried to move back new op lower bound from 7317515104870473728 to 7317515104805564416. Current Snapshot: MvccSnapshot[applied={T|T < 7317515104870473728}]
I20260812 02:45:11.165230 3503 catalog_manager.cc:1347] Generated new cluster ID: d2b04eb474a049d9ba011a2232d1dc9c
I20260812 02:45:11.165310 3503 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:45:11.183843 3503 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:45:11.184139 3152 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } attempt: 4
Aug 12 02:45:11 dist-test-slave-2p8l krb5kdc[2991](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502710, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for kudu/127.10.75.124@KRBTEST.COM
I20260812 02:45:11.191668 3503 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:45:11.194509 3155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:11.184608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44111 (local address 127.0.0.1:52298)
0812 02:45:11.184870 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:11.184886 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:11.184970 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:11.185247 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:11.185250 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:11.185471 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:11.185588 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:11.185595 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.186665 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.186669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:11.187511 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:11.187521 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.188262 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.188266 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:11.188359 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:11.188945 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:11.188960 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:11.190665 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:11.192784 (+ 2119us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:11.192787 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:11.192790 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:11.193075 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:11.193407 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:11.193410 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:11.193413 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:11.193503 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:11.193944 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:11.193947 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:11.194046 (+ 99us) client_negotiation.cc:769] Sending connection context
0812 02:45:11.194181 (+ 135us) client_negotiation.cc:240] Negotiation successful
0812 02:45:11.194327 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164}
I20260812 02:45:11.195266 3425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:11.184892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52298 (local address 127.10.75.124:44111)
0812 02:45:11.185005 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:11.185010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:11.185026 (+ 16us) server_negotiation.cc:407] Connection header received
0812 02:45:11.185064 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:11.185068 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:11.185111 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:11.185211 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:11.185725 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.186528 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.187651 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:11.188012 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:11.188116 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:11.190825 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:11.190829 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:11.190832 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:11.190857 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:11.192646 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.193200 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.193204 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.193206 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.193303 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:11.193603 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:11.193606 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:11.193608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:11.193810 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:11.193899 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:11.194962 (+ 1063us) server_negotiation.cc:299] Negotiation successful
0812 02:45:11.195111 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 02:45:11.198745 3152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b: Bootstrap starting.
I20260812 02:45:11.201707 3152 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:11.207489 3152 log.cc:824] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:11.209842 3152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b: No bootstrap required, opened a new log
I20260812 02:45:11.210278 3503 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad: Generated new TSK 0
I20260812 02:45:11.212186 3503 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:45:11.214008 3152 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } } peers { permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } } peers { permanent_uuid: "8403dd425a424a5b82236e5e3b802fad" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } }
I20260812 02:45:11.214584 3152 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:11.214685 3152 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed77aed14fe4d93a4d43509aaba457b, State: Initialized, Role: FOLLOWER
I20260812 02:45:11.215242 3152 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } } peers { permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } } peers { permanent_uuid: "8403dd425a424a5b82236e5e3b802fad" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } }
I20260812 02:45:11.216770 3152 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:45:11.217105 3096 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:11.218837 3096 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b [term 1 FOLLOWER]: Refusing update from remote peer 8403dd425a424a5b82236e5e3b802fad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:45:11.219691 3500 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:45:11.221179 3098 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8403dd425a424a5b82236e5e3b802fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed77aed14fe4d93a4d43509aaba457b"
I20260812 02:45:11.223009 3098 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8403dd425a424a5b82236e5e3b802fad in term 1.
I20260812 02:45:11.223337 3101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8403dd425a424a5b82236e5e3b802fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed77aed14fe4d93a4d43509aaba457b" is_pre_election: true
I20260812 02:45:11.223471 3101 raft_consensus.cc:2362] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8403dd425a424a5b82236e5e3b802fad in term 1. Re-sending same reply.
I20260812 02:45:11.230324 3538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8403dd425a424a5b82236e5e3b802fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } } peers { permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } } peers { permanent_uuid: "8403dd425a424a5b82236e5e3b802fad" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } } }
I20260812 02:45:11.230628 3538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:45:11.230811 3538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8403dd425a424a5b82236e5e3b802fad. Latest consensus state: current_term: 1 leader_uuid: "8403dd425a424a5b82236e5e3b802fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } } peers { permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } } peers { permanent_uuid: "8403dd425a424a5b82236e5e3b802fad" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } } }
I20260812 02:45:11.230962 3538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:45:11.231093 3538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8403dd425a424a5b82236e5e3b802fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } } peers { permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } } peers { permanent_uuid: "8403dd425a424a5b82236e5e3b802fad" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } } }
I20260812 02:45:11.231501 3538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:45:11.234565 3540 mvcc.cc:205] Tried to move back new op lower bound from 7317515105093816320 to 7317515104805564416. Current Snapshot: MvccSnapshot[applied={T|T < 7317515104870473728}]
W20260812 02:45:11.235623 3537 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:45:11.236584 3537 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:45:11.719892 3500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8403dd425a424a5b82236e5e3b802fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed77aed14fe4d93a4d43509aaba457b" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37809 } } peers { permanent_uuid: "494765ea4cd94973b2f121cbc075a16d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 37917 } } peers { permanent_uuid: "8403dd425a424a5b82236e5e3b802fad" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44111 } } }
I20260812 02:45:11.720185 3500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad [sys.catalog]: This master's current role is: LEADER
I20260812 02:45:12.074455 3456 catalog_manager.cc:1259] Loaded cluster ID: d2b04eb474a049d9ba011a2232d1dc9c
I20260812 02:45:12.074608 3456 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d: loading cluster ID for follower catalog manager: success
I20260812 02:45:12.077088 3456 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d: acquiring CA information for follower catalog manager: success
I20260812 02:45:12.079273 3456 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 494765ea4cd94973b2f121cbc075a16d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 02:45:12.238864 3537 catalog_manager.cc:1259] Loaded cluster ID: d2b04eb474a049d9ba011a2232d1dc9c
I20260812 02:45:12.239089 3537 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b: loading cluster ID for follower catalog manager: success
I20260812 02:45:12.241624 3537 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b: acquiring CA information for follower catalog manager: success
I20260812 02:45:12.243888 3537 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8ed77aed14fe4d93a4d43509aaba457b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 02:45:12.300618 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 3014
I20260812 02:45:12.325199 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 3164
I20260812 02:45:12.342898 3566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:12.342177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37809 (local address 127.0.0.1:46376)
0812 02:45:12.342531 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:12.342685 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":128,"threads_started":1}
W20260812 02:45:12.343338 3327 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37809: connect: Connection refused (error 111)
I20260812 02:45:12.344623 3566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:12.344292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37809 (local address 127.0.0.1:46382)
0812 02:45:12.344446 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:12.344529 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 02:45:12.344808 3327 consensus_peers.cc:487] T 00000000000000000000000000000000 P 8403dd425a424a5b82236e5e3b802fad -> Peer 8ed77aed14fe4d93a4d43509aaba457b (127.10.75.126:37809): Couldn't send request to peer 8ed77aed14fe4d93a4d43509aaba457b. Status: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 02:45:12.348888 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 3296
2026-08-12T02:45:12Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3529 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:45:12 dist-test-slave-2p8l krb5kdc[3573](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:45:12 dist-test-slave-2p8l krb5kdc[3573](info): set up 2 sockets
Aug 12 02:45:12 dist-test-slave-2p8l krb5kdc[3573](info): commencing operation
krb5kdc: starting...
W20260812 02:45:13.739391 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.331s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:45:13 dist-test-slave-2p8l krb5kdc[3573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:45:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:45:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:45:13.881471 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:42619
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:42619
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:45:14.004853 3599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:14.005367 3599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:14.005467 3599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:14.009747 3599 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:45:14.009816 3599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:14.009837 3599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:14.009855 3599 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:45:14.009871 3599 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:45:14.015667 3599 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:42619
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:42619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:14.016918 3599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:14.018112 3599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:14.027791 3604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:14.027791 3609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:14.027896 3599 server_base.cc:1034] running on GCE node
W20260812 02:45:14.027791 3612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:14.029052 3599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:14.030434 3599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:14.031670 3599 hybrid_clock.cc:648] HybridClock initialized: now 1786502714031624 us; error 31 us; skew 500 ppm
Aug 12 02:45:14 dist-test-slave-2p8l krb5kdc[3573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502714, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:14.034945 3599 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:45:14.036031 3599 webserver.cc:460] Webserver started at http://127.10.75.126:40347/ using document root <none> and password file <none>
I20260812 02:45:14.036643 3599 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:14.036710 3599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:14.036967 3599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:45:14.039292 3599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "8bb02bd9785040ee8e8cb99bea6c140a"
format_stamp: "Formatted at 2026-08-12 02:45:14 on dist-test-slave-2p8l"
server_key: "14cece6eaaf8fb76cc60e21d08d05ceb"
server_key_iv: "6c4a7205c21ad13514a322cfd2f24416"
server_key_version: "encryptionkey@0"
I20260812 02:45:14.039923 3599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "8bb02bd9785040ee8e8cb99bea6c140a"
format_stamp: "Formatted at 2026-08-12 02:45:14 on dist-test-slave-2p8l"
server_key: "14cece6eaaf8fb76cc60e21d08d05ceb"
server_key_iv: "6c4a7205c21ad13514a322cfd2f24416"
server_key_version: "encryptionkey@0"
I20260812 02:45:14.044096 3599 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 02:45:14.046868 3626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:14.048276 3599 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:45:14.048439 3599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "8bb02bd9785040ee8e8cb99bea6c140a"
format_stamp: "Formatted at 2026-08-12 02:45:14 on dist-test-slave-2p8l"
server_key: "14cece6eaaf8fb76cc60e21d08d05ceb"
server_key_iv: "6c4a7205c21ad13514a322cfd2f24416"
server_key_version: "encryptionkey@0"
I20260812 02:45:14.048563 3599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:14.059317 3599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:14.063043 3599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:14.063268 3599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:14.071578 3599 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:42619
I20260812 02:45:14.071691 3725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:42619 every 8 connection(s)
I20260812 02:45:14.072767 3599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:45:14.075825 3729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:14.080128 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 3599
I20260812 02:45:14.080281 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:45:14.080619 10541 external_mini_cluster.cc:1428] Setting key 3ee4e44480d2d15ce64ac83722fa76c1
I20260812 02:45:14.082513 3729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a: Bootstrap starting.
I20260812 02:45:14.085136 3729 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:14.085915 3729 log.cc:824] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:14.088250 3729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a: No bootstrap required, opened a new log
Aug 12 02:45:14 dist-test-slave-2p8l krb5kdc[3573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:14.092506 3729 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bb02bd9785040ee8e8cb99bea6c140a" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42619 } }
I20260812 02:45:14.092785 3729 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:14.092880 3729 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bb02bd9785040ee8e8cb99bea6c140a, State: Initialized, Role: FOLLOWER
I20260812 02:45:14.093376 3729 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bb02bd9785040ee8e8cb99bea6c140a" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42619 } }
I20260812 02:45:14.093547 3729 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:45:14.093637 3729 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:45:14.093741 3729 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:14.094772 3729 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bb02bd9785040ee8e8cb99bea6c140a" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42619 } }
I20260812 02:45:14.095134 3729 leader_election.cc:302] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8bb02bd9785040ee8e8cb99bea6c140a; no voters:
I20260812 02:45:14.095500 3729 leader_election.cc:288] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:45:14.095676 3734 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:45:14.095873 3734 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a [term 1 LEADER]: Becoming Leader. State: Replica: 8bb02bd9785040ee8e8cb99bea6c140a, State: Running, Role: LEADER
I20260812 02:45:14.096190 3734 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bb02bd9785040ee8e8cb99bea6c140a" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42619 } }
I20260812 02:45:14.096690 3732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:14.082162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38616 (local address 127.10.75.126:42619)
0812 02:45:14.082677 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:14.082709 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:14.082747 (+ 38us) server_negotiation.cc:407] Connection header received
0812 02:45:14.083415 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:14.083433 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:14.083778 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:14.084077 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:14.085051 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:14.086285 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:14.087565 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:14.088071 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:14.088211 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:14.091344 (+ 3133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:14.091350 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:14.091364 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:14.091393 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:14.093353 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:14.093893 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:14.093906 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:14.093911 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:14.094027 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:14.094382 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:14.094386 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:14.094388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:14.094806 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:14.095011 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:14.095358 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 02:45:14.095707 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":157,"threads_started":1}
I20260812 02:45:14.096881 3729 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:45:14.097401 3734 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8bb02bd9785040ee8e8cb99bea6c140a. Latest consensus state: current_term: 1 leader_uuid: "8bb02bd9785040ee8e8cb99bea6c140a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bb02bd9785040ee8e8cb99bea6c140a" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42619 } } }
I20260812 02:45:14.097522 3734 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a [sys.catalog]: This master's current role is: LEADER
I20260812 02:45:14.098052 3737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8bb02bd9785040ee8e8cb99bea6c140a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bb02bd9785040ee8e8cb99bea6c140a" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42619 } } }
I20260812 02:45:14.098215 3737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a [sys.catalog]: This master's current role is: LEADER
I20260812 02:45:14.099946 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260812 02:45:14.101845 3760 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:45:14.101943 3760 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:45:14.102027 3741 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:45:14.102766 3741 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:45:14.109280 3741 catalog_manager.cc:1347] Generated new cluster ID: 86da72a274934f7a92638137f5ea5b38
I20260812 02:45:14.109414 3741 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:45:14.137727 3741 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:45:14.138897 3741 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:45:14.153023 3741 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8bb02bd9785040ee8e8cb99bea6c140a: Generated new TSK 0
I20260812 02:45:14.153901 3741 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:45:14.208145 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 3599
2026-08-12T02:45:14Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1841 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:45:14 dist-test-slave-2p8l krb5kdc[3772](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:45:14 dist-test-slave-2p8l krb5kdc[3772](info): set up 2 sockets
Aug 12 02:45:14 dist-test-slave-2p8l krb5kdc[3772](info): commencing operation
krb5kdc: starting...
W20260812 02:45:15.544416 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.294s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:45:15 dist-test-slave-2p8l krb5kdc[3772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:45:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:45:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:45:15.685081 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:37925
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:37925
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:45:15.799736 3791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:15.800057 3791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:15.800135 3791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:15.804957 3791 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:45:15.805073 3791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:15.805109 3791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:15.805152 3791 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:45:15.805187 3791 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:45:15.810900 3791 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:37925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:37925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:15.812130 3791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:15.813241 3791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:15.822377 3805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:15.822427 3803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:15.822391 3800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:15.822692 3791 server_base.cc:1034] running on GCE node
I20260812 02:45:15.823329 3791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:15.824535 3791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:15.825766 3791 hybrid_clock.cc:648] HybridClock initialized: now 1786502715825740 us; error 46 us; skew 500 ppm
Aug 12 02:45:15 dist-test-slave-2p8l krb5kdc[3772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502715, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:15.836988 3791 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:45:15.838024 3791 webserver.cc:460] Webserver started at http://127.10.75.126:42959/ using document root <none> and password file <none>
I20260812 02:45:15.838667 3791 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:15.838743 3791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:15.838924 3791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:45:15.841010 3791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "9028f42d00cf465a89ad9bf32b147073"
format_stamp: "Formatted at 2026-08-12 02:45:15 on dist-test-slave-2p8l"
server_key: "174244640a398db594e132548eddad24"
server_key_iv: "2b603b6e963c2097c7acc11fc822554f"
server_key_version: "encryptionkey@0"
I20260812 02:45:15.841535 3791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "9028f42d00cf465a89ad9bf32b147073"
format_stamp: "Formatted at 2026-08-12 02:45:15 on dist-test-slave-2p8l"
server_key: "174244640a398db594e132548eddad24"
server_key_iv: "2b603b6e963c2097c7acc11fc822554f"
server_key_version: "encryptionkey@0"
I20260812 02:45:15.845403 3791 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260812 02:45:15.848052 3821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:15.849318 3791 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260812 02:45:15.849555 3791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "9028f42d00cf465a89ad9bf32b147073"
format_stamp: "Formatted at 2026-08-12 02:45:15 on dist-test-slave-2p8l"
server_key: "174244640a398db594e132548eddad24"
server_key_iv: "2b603b6e963c2097c7acc11fc822554f"
server_key_version: "encryptionkey@0"
I20260812 02:45:15.849670 3791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:15.864991 3791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:15.868294 3791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:15.868525 3791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:15.877230 3791 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:37925
I20260812 02:45:15.877547 3909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:37925 every 8 connection(s)
I20260812 02:45:15.878355 3791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:45:15.881214 3916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:15.882835 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 3791
I20260812 02:45:15.882964 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:45:15.883286 10541 external_mini_cluster.cc:1428] Setting key 3d686e4e2013a79fbecb187ea4f7870e
I20260812 02:45:15.888005 3916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073: Bootstrap starting.
I20260812 02:45:15.890764 3916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:15.891784 3916 log.cc:824] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073: Log is configured to *not* fsync() on all Append() calls
Aug 12 02:45:15 dist-test-slave-2p8l krb5kdc[3772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:15.893991 3916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073: No bootstrap required, opened a new log
I20260812 02:45:15.898173 3916 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9028f42d00cf465a89ad9bf32b147073" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37925 } }
I20260812 02:45:15.898418 3916 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:15.898499 3916 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9028f42d00cf465a89ad9bf32b147073, State: Initialized, Role: FOLLOWER
I20260812 02:45:15.898500 3919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:15.884732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41074 (local address 127.10.75.126:37925)
0812 02:45:15.885166 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:15.885183 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:15.885220 (+ 37us) server_negotiation.cc:407] Connection header received
0812 02:45:15.885871 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:15.885887 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:15.886253 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:15.886536 (+ 283us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:15.887468 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:15.888578 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:15.889814 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:15.890316 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:15.890440 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:15.893401 (+ 2961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:15.893407 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:15.893421 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:15.893448 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:15.895291 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:15.895852 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:15.895857 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:15.895862 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:15.895975 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:15.896313 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:15.896315 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:15.896316 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:15.896709 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:15.896852 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:15.897188 (+ 336us) server_negotiation.cc:299] Negotiation successful
0812 02:45:15.897614 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":138,"threads_started":1}
I20260812 02:45:15.899044 3916 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9028f42d00cf465a89ad9bf32b147073" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37925 } }
I20260812 02:45:15.899214 3916 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:45:15.899281 3916 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:45:15.899372 3916 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:15.900336 3916 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9028f42d00cf465a89ad9bf32b147073" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37925 } }
I20260812 02:45:15.900717 3916 leader_election.cc:302] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9028f42d00cf465a89ad9bf32b147073; no voters:
I20260812 02:45:15.901072 3916 leader_election.cc:288] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:45:15.901206 3922 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:45:15.901433 3922 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 1 LEADER]: Becoming Leader. State: Replica: 9028f42d00cf465a89ad9bf32b147073, State: Running, Role: LEADER
I20260812 02:45:15.901811 3922 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9028f42d00cf465a89ad9bf32b147073" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37925 } }
I20260812 02:45:15.902443 3916 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:45:15.903955 3924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9028f42d00cf465a89ad9bf32b147073. Latest consensus state: current_term: 1 leader_uuid: "9028f42d00cf465a89ad9bf32b147073" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9028f42d00cf465a89ad9bf32b147073" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37925 } } }
I20260812 02:45:15.903990 3923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9028f42d00cf465a89ad9bf32b147073" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9028f42d00cf465a89ad9bf32b147073" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37925 } } }
I20260812 02:45:15.904084 3924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [sys.catalog]: This master's current role is: LEADER
I20260812 02:45:15.904093 3923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [sys.catalog]: This master's current role is: LEADER
W20260812 02:45:15.907438 3943 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:45:15.907513 3943 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:45:15.907575 3938 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:45:15.908486 3938 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:45:15.914304 3938 catalog_manager.cc:1347] Generated new cluster ID: 5ebab4ee51d04a81a3e508066ab29a0b
I20260812 02:45:15.914376 3938 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:45:15.940928 3938 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:45:15.942306 3938 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:45:15.947983 3938 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073: Generated new TSK 0
I20260812 02:45:15.948804 3938 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
I20260812 02:45:15.990008 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:37925
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:45:16.111184 3961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:16.111464 3961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:16.111508 3961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:16.115505 3961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:16.115569 3961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:16.115634 3961 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:45:16.121008 3961 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:37925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3961
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:16.122036 3961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:16.123206 3961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:16.133737 3977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:16.133729 3972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:16.133805 3961 server_base.cc:1034] running on GCE node
W20260812 02:45:16.133729 3973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:16.134443 3961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:16.135178 3961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:16.136425 3961 hybrid_clock.cc:648] HybridClock initialized: now 1786502716136392 us; error 45 us; skew 500 ppm
Aug 12 02:45:16 dist-test-slave-2p8l krb5kdc[3772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502716, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:16.139533 3961 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:45:16.140506 3961 webserver.cc:460] Webserver started at http://127.10.75.65:39961/ using document root <none> and password file <none>
I20260812 02:45:16.141146 3961 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:16.141245 3961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:16.141490 3961 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:45:16.143728 3961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "cd3eeeaec6b8405384ac6f80ba534b2b"
format_stamp: "Formatted at 2026-08-12 02:45:16 on dist-test-slave-2p8l"
server_key: "7cd4925d0a2a693c631245e7daa65ae8"
server_key_iv: "cc0dc61a75d057697fd04587dde2543a"
server_key_version: "encryptionkey@0"
I20260812 02:45:16.144318 3961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "cd3eeeaec6b8405384ac6f80ba534b2b"
format_stamp: "Formatted at 2026-08-12 02:45:16 on dist-test-slave-2p8l"
server_key: "7cd4925d0a2a693c631245e7daa65ae8"
server_key_iv: "cc0dc61a75d057697fd04587dde2543a"
server_key_version: "encryptionkey@0"
I20260812 02:45:16.148326 3961 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260812 02:45:16.151386 3990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:16.152792 3961 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 02:45:16.152948 3961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "cd3eeeaec6b8405384ac6f80ba534b2b"
format_stamp: "Formatted at 2026-08-12 02:45:16 on dist-test-slave-2p8l"
server_key: "7cd4925d0a2a693c631245e7daa65ae8"
server_key_iv: "cc0dc61a75d057697fd04587dde2543a"
server_key_version: "encryptionkey@0"
I20260812 02:45:16.153077 3961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:16.165902 3961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:16.169914 3961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:16.170338 3961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:16.170948 3961 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:16.171794 3961 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:45:16.171844 3961 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:16.171885 3961 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:45:16.171901 3961 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:16.182964 3961 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:42077
I20260812 02:45:16.183135 4194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:42077 every 8 connection(s)
I20260812 02:45:16.183954 3961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:45:16.188911 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 3961
I20260812 02:45:16.189056 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:45:16.189391 10541 external_mini_cluster.cc:1428] Setting key 56feb8772000431649386fcdf08c70c2
Aug 12 02:45:16 dist-test-slave-2p8l krb5kdc[3772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502716, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:16.199528 3919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:16.186049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:60883 (local address 127.10.75.126:37925)
0812 02:45:16.186229 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:16.186232 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:16.187187 (+ 955us) server_negotiation.cc:407] Connection header received
0812 02:45:16.188565 (+ 1378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:16.188568 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:16.188618 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:16.188696 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:16.190353 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.190896 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.192687 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.192927 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.193040 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:16.195681 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:16.195690 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:16.195692 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:16.195716 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:16.197295 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:16.197871 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:16.197874 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:16.197876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:16.197960 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:16.198381 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:16.198384 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:16.198386 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:16.198572 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:16.198685 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:16.199199 (+ 514us) server_negotiation.cc:299] Negotiation successful
0812 02:45:16.199346 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
WARNING: no policy specified for kudu/127.10.75.66@KRBTEST.COM; defaulting to no policy
I20260812 02:45:16.200413 4197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:16.186479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:60883)
0812 02:45:16.186993 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:16.187040 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:16.188346 (+ 1306us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:16.188925 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:16.188937 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:16.189489 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:16.190186 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:16.190209 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.191034 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.191038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:16.192549 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:16.192560 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.193096 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.193101 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:16.193280 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:16.193956 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:16.193979 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:16.195503 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:16.197420 (+ 1917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:16.197426 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:16.197441 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:16.197754 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:16.198119 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:16.198122 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:16.198124 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:16.198267 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:16.198683 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:16.198691 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:16.198940 (+ 249us) client_negotiation.cc:769] Sending connection context
0812 02:45:16.199138 (+ 198us) client_negotiation.cc:240] Negotiation successful
0812 02:45:16.199489 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":139,"threads_started":1}
I20260812 02:45:16.201773 4195 heartbeater.cc:347] Connected to a master server at 127.10.75.126:37925
I20260812 02:45:16.202042 4195 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:16.202668 4195 heartbeater.cc:511] Master 127.10.75.126:37925 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.66@KRBTEST.COM" created.
I20260812 02:45:16.204463 3850 ts_manager.cc:194] Registered new tserver with Master: cd3eeeaec6b8405384ac6f80ba534b2b (127.10.75.65:42077)
I20260812 02:45:16.205725 3850 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:60883
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
I20260812 02:45:16.222540 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:37925
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:45:16.336874 4202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:16.337123 4202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:16.337167 4202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:16.341216 4202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:16.341266 4202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:16.341369 4202 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:45:16.346791 4202 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:37925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4202
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:16.347898 4202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:16.348946 4202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:16.359118 4214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:16.359150 4212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:16.359302 4202 server_base.cc:1034] running on GCE node
W20260812 02:45:16.359119 4216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:16.359927 4202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:16.360649 4202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:16.361863 4202 hybrid_clock.cc:648] HybridClock initialized: now 1786502716361848 us; error 26 us; skew 500 ppm
Aug 12 02:45:16 dist-test-slave-2p8l krb5kdc[3772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502716, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:16.364920 4202 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:45:16.365864 4202 webserver.cc:460] Webserver started at http://127.10.75.66:38523/ using document root <none> and password file <none>
I20260812 02:45:16.366480 4202 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:16.366546 4202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:16.366729 4202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:45:16.368793 4202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "8dc6f55d632149fb901be88fdbed6447"
format_stamp: "Formatted at 2026-08-12 02:45:16 on dist-test-slave-2p8l"
server_key: "c1cf9df979ff503b0c4fe10e1651cd08"
server_key_iv: "cd6d35c4983db4239edb23f49f32eed7"
server_key_version: "encryptionkey@0"
I20260812 02:45:16.369342 4202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "8dc6f55d632149fb901be88fdbed6447"
format_stamp: "Formatted at 2026-08-12 02:45:16 on dist-test-slave-2p8l"
server_key: "c1cf9df979ff503b0c4fe10e1651cd08"
server_key_iv: "cd6d35c4983db4239edb23f49f32eed7"
server_key_version: "encryptionkey@0"
I20260812 02:45:16.373306 4202 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 02:45:16.376019 4227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:16.377346 4202 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 02:45:16.377506 4202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "8dc6f55d632149fb901be88fdbed6447"
format_stamp: "Formatted at 2026-08-12 02:45:16 on dist-test-slave-2p8l"
server_key: "c1cf9df979ff503b0c4fe10e1651cd08"
server_key_iv: "cd6d35c4983db4239edb23f49f32eed7"
server_key_version: "encryptionkey@0"
I20260812 02:45:16.377631 4202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:16.405387 4202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:16.408936 4202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:16.409159 4202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:16.409809 4202 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:16.410755 4202 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:45:16.410806 4202 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:16.410877 4202 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:45:16.410914 4202 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:16.419885 4202 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:41775
I20260812 02:45:16.419962 4435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:41775 every 8 connection(s)
I20260812 02:45:16.420832 4202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:45:16.430459 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 4202
I20260812 02:45:16.430605 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
Aug 12 02:45:16 dist-test-slave-2p8l krb5kdc[3772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502716, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:16.430946 10541 external_mini_cluster.cc:1428] Setting key ebe5b7d353d57a112665cb243c7be722
I20260812 02:45:16.435310 3919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:16.422787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:58131 (local address 127.10.75.126:37925)
0812 02:45:16.422960 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:16.422963 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:16.423879 (+ 916us) server_negotiation.cc:407] Connection header received
0812 02:45:16.425322 (+ 1443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:16.425326 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:16.425384 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:16.425468 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:16.426683 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.427229 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.428382 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.428621 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.428739 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:16.431516 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:16.431520 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:16.431523 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:16.431559 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:16.433087 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:16.433653 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:16.433657 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:16.433659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:16.433745 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:16.434151 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:16.434154 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:16.434156 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:16.434350 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:16.434464 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:16.434996 (+ 532us) server_negotiation.cc:299] Negotiation successful
0812 02:45:16.435123 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 02:45:16.436225 4440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:16.423197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:58131)
0812 02:45:16.423715 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:16.423758 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:16.425103 (+ 1345us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:16.425636 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:16.425643 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:16.425995 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:16.426535 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:16.426548 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.427366 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.427374 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:16.428245 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:16.428254 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.428785 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.428789 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:16.428958 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:16.429542 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:16.429559 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:16.431330 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:16.433238 (+ 1908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:16.433244 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:16.433258 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:16.433540 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:16.433844 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:16.433849 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:16.433851 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:16.434001 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:16.434465 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:16.434473 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:16.434740 (+ 267us) client_negotiation.cc:769] Sending connection context
0812 02:45:16.434935 (+ 195us) client_negotiation.cc:240] Negotiation successful
0812 02:45:16.435272 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":125,"threads_started":1}
I20260812 02:45:16.437458 4436 heartbeater.cc:347] Connected to a master server at 127.10.75.126:37925
I20260812 02:45:16.437714 4436 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:16.438305 4436 heartbeater.cc:511] Master 127.10.75.126:37925 requested a full tablet report, sending...
I20260812 02:45:16.439424 3850 ts_manager.cc:194] Registered new tserver with Master: 8dc6f55d632149fb901be88fdbed6447 (127.10.75.66:41775)
I20260812 02:45:16.440039 3850 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:58131
WARNING: no policy specified for kudu/127.10.75.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
I20260812 02:45:16.465920 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:37925
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:45:16.582407 4445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:16.582715 4445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:16.582792 4445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:16.587891 4445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:16.588109 4445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:16.588212 4445 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:45:16.594005 4445 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:37925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4445
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:16.595469 4445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:16.596618 4445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 02:45:16.607081 4445 server_base.cc:1034] running on GCE node
W20260812 02:45:16.607012 4457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:16.606997 4463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:16.607035 4459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:16.607720 4445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:16.608421 4445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:16.609593 4445 hybrid_clock.cc:648] HybridClock initialized: now 1786502716609573 us; error 37 us; skew 500 ppm
Aug 12 02:45:16 dist-test-slave-2p8l krb5kdc[3772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502716, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:16.612557 4445 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:45:16.613531 4445 webserver.cc:460] Webserver started at http://127.10.75.67:34445/ using document root <none> and password file <none>
I20260812 02:45:16.614185 4445 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:16.614293 4445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:16.614537 4445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:45:16.616657 4445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "afa61c1031934a3d948a376413d44ae2"
format_stamp: "Formatted at 2026-08-12 02:45:16 on dist-test-slave-2p8l"
server_key: "3d3ca374255fb9a9d31eb5c07a88cdb0"
server_key_iv: "4247c53be28e9acad10f42028e01476c"
server_key_version: "encryptionkey@0"
I20260812 02:45:16.617255 4445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "afa61c1031934a3d948a376413d44ae2"
format_stamp: "Formatted at 2026-08-12 02:45:16 on dist-test-slave-2p8l"
server_key: "3d3ca374255fb9a9d31eb5c07a88cdb0"
server_key_iv: "4247c53be28e9acad10f42028e01476c"
server_key_version: "encryptionkey@0"
I20260812 02:45:16.621188 4445 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260812 02:45:16.623916 4479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:16.625306 4445 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 02:45:16.625481 4445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "afa61c1031934a3d948a376413d44ae2"
format_stamp: "Formatted at 2026-08-12 02:45:16 on dist-test-slave-2p8l"
server_key: "3d3ca374255fb9a9d31eb5c07a88cdb0"
server_key_iv: "4247c53be28e9acad10f42028e01476c"
server_key_version: "encryptionkey@0"
I20260812 02:45:16.625615 4445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:16.639122 4445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:16.642243 4445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:16.642452 4445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:16.643069 4445 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:16.643980 4445 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:45:16.644057 4445 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:16.644131 4445 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:45:16.644183 4445 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:16.654269 4445 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:42245
I20260812 02:45:16.654335 4703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:42245 every 8 connection(s)
I20260812 02:45:16.655272 4445 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:45:16.663717 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 4445
I20260812 02:45:16.663820 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:45:16.664135 10541 external_mini_cluster.cc:1428] Setting key 1716895e0f759383f9349fea50a2e79a
Aug 12 02:45:16 dist-test-slave-2p8l krb5kdc[3772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502716, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:16.669953 3919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:16.657217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:42431 (local address 127.10.75.126:37925)
0812 02:45:16.657368 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:16.657372 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:16.658287 (+ 915us) server_negotiation.cc:407] Connection header received
0812 02:45:16.659646 (+ 1359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:16.659649 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:16.659706 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:16.659783 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:16.661044 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.661591 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.662900 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.663124 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.663216 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:16.666355 (+ 3139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:16.666358 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:16.666360 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:16.666385 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:16.667996 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:16.668509 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:16.668512 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:16.668513 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:16.668588 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:16.668938 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:16.668941 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:16.668942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:16.669137 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:16.669225 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:16.669716 (+ 491us) server_negotiation.cc:299] Negotiation successful
0812 02:45:16.669819 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 02:45:16.670816 4709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:16.657622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:42431)
0812 02:45:16.658134 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:16.658182 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:16.659442 (+ 1260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:16.659987 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:16.659994 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:16.660366 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:16.660895 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:16.660910 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.661745 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.661748 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:16.662737 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:16.662747 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.663288 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.663291 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:16.663432 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:16.664136 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:16.664153 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:16.666184 (+ 2031us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:16.668110 (+ 1926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:16.668115 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:16.668127 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:16.668409 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:16.668667 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:16.668670 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:16.668672 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:16.668806 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:16.669237 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:16.669242 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:16.669472 (+ 230us) client_negotiation.cc:769] Sending connection context
0812 02:45:16.669630 (+ 158us) client_negotiation.cc:240] Negotiation successful
0812 02:45:16.669902 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":121,"threads_started":1}
I20260812 02:45:16.671988 4704 heartbeater.cc:347] Connected to a master server at 127.10.75.126:37925
I20260812 02:45:16.672237 4704 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:16.672742 4704 heartbeater.cc:511] Master 127.10.75.126:37925 requested a full tablet report, sending...
I20260812 02:45:16.673794 3850 ts_manager.cc:194] Registered new tserver with Master: afa61c1031934a3d948a376413d44ae2 (127.10.75.67:42245)
I20260812 02:45:16.674396 3850 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:42431
I20260812 02:45:16.678306 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:45:16.688071 3919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:16.680317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40882 (local address 127.10.75.126:37925)
0812 02:45:16.680504 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:16.680509 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:16.680653 (+ 144us) server_negotiation.cc:407] Connection header received
0812 02:45:16.680795 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:16.680798 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:16.680847 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:16.680952 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:16.681703 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.682290 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.683140 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.683360 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.683474 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:16.684879 (+ 1405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:16.684883 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:16.684885 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:16.684918 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:16.686318 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:16.686745 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:16.686749 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:16.686751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:16.686834 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:16.687115 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:16.687119 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:16.687120 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:16.687343 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:16.687487 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:16.687783 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 02:45:16.687898 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260812 02:45:16.691075 3850 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40882:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:45:16.694228 3850 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:45:16.709612 4730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:16.703516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:42077 (local address 127.0.0.1:36462)
0812 02:45:16.703895 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:16.703958 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:16.704085 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:16.705123 (+ 1038us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:16.705131 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:16.705157 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:16.705309 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:16.705316 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.706735 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.706740 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:16.708028 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:16.708039 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.709010 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.709013 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:16.709124 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:16.709176 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 02:45:16.709337 (+ 161us) client_negotiation.cc:240] Negotiation successful
0812 02:45:16.709470 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":101,"threads_started":1}
I20260812 02:45:16.709626 4733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:16.704265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36462 (local address 127.10.75.65:42077)
0812 02:45:16.704555 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:16.704564 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:16.704592 (+ 28us) server_negotiation.cc:407] Connection header received
0812 02:45:16.704704 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:16.704713 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:16.704937 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:16.705494 (+ 557us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:16.705648 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.706606 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.708165 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.708878 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.709009 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:16.709168 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:16.709358 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 02:45:16.709459 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":83,"threads_started":1}
I20260812 02:45:16.709815 4732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:16.703796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:41775 (local address 127.0.0.1:40570)
0812 02:45:16.704837 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:16.704851 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:16.704938 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:16.705522 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:16.705525 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:16.705543 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:16.705669 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:16.705680 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.707174 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.707178 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:16.708266 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:16.708274 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.709419 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.709423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:16.709515 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:16.709538 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 02:45:16.709594 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 02:45:16.709660 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":973,"thread_start_us":121,"threads_started":1}
I20260812 02:45:16.710407 4734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:16.704361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35246 (local address 127.10.75.67:42245)
0812 02:45:16.704857 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:16.704868 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:16.705334 (+ 466us) server_negotiation.cc:407] Connection header received
0812 02:45:16.705410 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:16.705414 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:16.705598 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:16.705766 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:16.705982 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.707086 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.708511 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.709298 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.709402 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:16.709533 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:16.710138 (+ 605us) server_negotiation.cc:299] Negotiation successful
0812 02:45:16.710240 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":145,"threads_started":1}
I20260812 02:45:16.710003 4731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:16.703924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:42245 (local address 127.0.0.1:35246)
0812 02:45:16.705127 (+ 1203us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:16.705140 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:16.705246 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:16.705739 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:16.705742 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:16.705761 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:16.705861 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:16.705867 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.707261 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.707265 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:16.708382 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:16.708393 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.709596 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.709601 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:16.709721 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:16.709743 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 02:45:16.709814 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 02:45:16.709896 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1143,"mutex_wait_us":1,"thread_start_us":94,"threads_started":1}
I20260812 02:45:16.710558 4735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:16.704361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40570 (local address 127.10.75.66:41775)
0812 02:45:16.705066 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:16.705079 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:16.705102 (+ 23us) server_negotiation.cc:407] Connection header received
0812 02:45:16.705172 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:16.705188 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:16.705376 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:16.705522 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:16.705814 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.707026 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.708383 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.709264 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.709925 (+ 661us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:16.710107 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:16.710155 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 02:45:16.710391 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":173,"threads_started":1}
I20260812 02:45:16.713313 4577 tablet_service.cc:1467] Processing CreateTablet for tablet a6e011beadda477395db37ddef198968 (DEFAULT_TABLE table=test-table [id=17ded880d19a41cb8935b6500273d444]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:45:16.713336 4313 tablet_service.cc:1467] Processing CreateTablet for tablet a6e011beadda477395db37ddef198968 (DEFAULT_TABLE table=test-table [id=17ded880d19a41cb8935b6500273d444]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:45:16.713335 4087 tablet_service.cc:1467] Processing CreateTablet for tablet a6e011beadda477395db37ddef198968 (DEFAULT_TABLE table=test-table [id=17ded880d19a41cb8935b6500273d444]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:45:16.714419 4087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6e011beadda477395db37ddef198968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:16.714419 4313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6e011beadda477395db37ddef198968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:16.714457 4577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6e011beadda477395db37ddef198968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:16.720770 4737 tablet_bootstrap.cc:492] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2: Bootstrap starting.
I20260812 02:45:16.722312 4739 tablet_bootstrap.cc:492] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b: Bootstrap starting.
I20260812 02:45:16.722313 4741 tablet_bootstrap.cc:492] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447: Bootstrap starting.
I20260812 02:45:16.723099 4737 tablet_bootstrap.cc:654] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:16.724337 4737 log.cc:824] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:16.724543 4739 tablet_bootstrap.cc:654] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:16.724980 4741 tablet_bootstrap.cc:654] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:16.725461 4739 log.cc:824] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:16.725792 4741 log.cc:824] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:16.726943 4737 tablet_bootstrap.cc:492] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2: No bootstrap required, opened a new log
I20260812 02:45:16.727150 4737 ts_tablet_manager.cc:1397] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 02:45:16.727491 4739 tablet_bootstrap.cc:492] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b: No bootstrap required, opened a new log
I20260812 02:45:16.727696 4739 ts_tablet_manager.cc:1397] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 02:45:16.727777 4741 tablet_bootstrap.cc:492] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447: No bootstrap required, opened a new log
I20260812 02:45:16.727957 4741 ts_tablet_manager.cc:1397] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260812 02:45:16.731290 4739 raft_consensus.cc:348] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } }
I20260812 02:45:16.731298 4737 raft_consensus.cc:348] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } }
I20260812 02:45:16.731549 4737 raft_consensus.cc:374] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:16.731551 4739 raft_consensus.cc:374] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:16.731606 4739 raft_consensus.cc:729] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd3eeeaec6b8405384ac6f80ba534b2b, State: Initialized, Role: FOLLOWER
I20260812 02:45:16.731606 4737 raft_consensus.cc:729] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afa61c1031934a3d948a376413d44ae2, State: Initialized, Role: FOLLOWER
I20260812 02:45:16.732060 4739 consensus_queue.cc:260] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } }
I20260812 02:45:16.732066 4737 consensus_queue.cc:260] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } }
I20260812 02:45:16.732831 4195 heartbeater.cc:503] Master 127.10.75.126:37925 was elected leader, sending a full tablet report...
I20260812 02:45:16.732806 4741 raft_consensus.cc:348] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } }
I20260812 02:45:16.733057 4741 raft_consensus.cc:374] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:16.733106 4741 raft_consensus.cc:729] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc6f55d632149fb901be88fdbed6447, State: Initialized, Role: FOLLOWER
I20260812 02:45:16.733188 4739 ts_tablet_manager.cc:1428] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260812 02:45:16.733552 4737 ts_tablet_manager.cc:1428] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 02:45:16.733502 4741 consensus_queue.cc:260] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } }
I20260812 02:45:16.733912 4704 heartbeater.cc:503] Master 127.10.75.126:37925 was elected leader, sending a full tablet report...
I20260812 02:45:16.734434 4741 ts_tablet_manager.cc:1428] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260812 02:45:16.734498 4436 heartbeater.cc:503] Master 127.10.75.126:37925 was elected leader, sending a full tablet report...
I20260812 02:45:16.738304 4750 raft_consensus.cc:482] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:45:16.738483 4750 raft_consensus.cc:504] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } }
I20260812 02:45:16.739537 4750 leader_election.cc:288] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd3eeeaec6b8405384ac6f80ba534b2b (127.10.75.65:42077), 8dc6f55d632149fb901be88fdbed6447 (127.10.75.66:41775)
I20260812 02:45:16.743805 4735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:16.739855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:53269 (local address 127.10.75.66:41775)
0812 02:45:16.740002 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:16.740008 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:16.740325 (+ 317us) server_negotiation.cc:407] Connection header received
0812 02:45:16.740383 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:16.740386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:16.740434 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:16.740520 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:16.740901 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.741540 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.742784 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.743220 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.743326 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:16.743367 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:16.743596 (+ 229us) server_negotiation.cc:299] Negotiation successful
0812 02:45:16.743686 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 02:45:16.743815 4755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:16.739761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:41775 (local address 127.10.75.67:53269)
0812 02:45:16.740197 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:16.740211 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:16.740303 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:16.740544 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:16.740547 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:16.740566 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:16.740707 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:16.740714 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.741654 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.741657 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:16.742648 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:16.742658 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.743350 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.743355 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:16.743465 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:16.743489 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 02:45:16.743565 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 02:45:16.743634 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":114,"threads_started":1}
I20260812 02:45:16.743927 4733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:16.740283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:36965 (local address 127.10.75.65:42077)
0812 02:45:16.740569 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:16.740573 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:16.740586 (+ 13us) server_negotiation.cc:407] Connection header received
0812 02:45:16.740630 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:16.740635 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:16.740730 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:16.740807 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:16.741195 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.741765 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.742872 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.743331 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.743452 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:16.743499 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:16.743721 (+ 222us) server_negotiation.cc:299] Negotiation successful
0812 02:45:16.743793 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205}
I20260812 02:45:16.744230 4709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:16.739730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:42077 (local address 127.10.75.67:36965)
0812 02:45:16.740001 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:16.740017 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:16.740104 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:16.740948 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:16.740951 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:16.740969 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:16.741071 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:16.741077 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.741879 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.741881 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:16.742709 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:16.742742 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.743464 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.743467 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:16.743580 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:16.743603 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 02:45:16.743689 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 02:45:16.743762 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":1}
I20260812 02:45:16.744639 4352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6e011beadda477395db37ddef198968" candidate_uuid: "afa61c1031934a3d948a376413d44ae2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc6f55d632149fb901be88fdbed6447" is_pre_election: true
I20260812 02:45:16.744880 4117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6e011beadda477395db37ddef198968" candidate_uuid: "afa61c1031934a3d948a376413d44ae2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" is_pre_election: true
I20260812 02:45:16.744958 4352 raft_consensus.cc:2454] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afa61c1031934a3d948a376413d44ae2 in term 0.
I20260812 02:45:16.745153 4117 raft_consensus.cc:2454] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afa61c1031934a3d948a376413d44ae2 in term 0.
I20260812 02:45:16.745447 4483 leader_election.cc:302] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc6f55d632149fb901be88fdbed6447, afa61c1031934a3d948a376413d44ae2; no voters:
I20260812 02:45:16.745731 4750 raft_consensus.cc:2781] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:45:16.745818 4750 raft_consensus.cc:482] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:45:16.745862 4750 raft_consensus.cc:3037] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:16.746955 4750 raft_consensus.cc:504] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } }
I20260812 02:45:16.747287 4750 leader_election.cc:288] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [CANDIDATE]: Term 1 election: Requested vote from peers cd3eeeaec6b8405384ac6f80ba534b2b (127.10.75.65:42077), 8dc6f55d632149fb901be88fdbed6447 (127.10.75.66:41775)
I20260812 02:45:16.747611 4117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6e011beadda477395db37ddef198968" candidate_uuid: "afa61c1031934a3d948a376413d44ae2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b"
I20260812 02:45:16.747653 4352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6e011beadda477395db37ddef198968" candidate_uuid: "afa61c1031934a3d948a376413d44ae2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc6f55d632149fb901be88fdbed6447"
I20260812 02:45:16.747748 4352 raft_consensus.cc:3037] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:16.747785 4117 raft_consensus.cc:3037] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:16.748728 4352 raft_consensus.cc:2454] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afa61c1031934a3d948a376413d44ae2 in term 1.
I20260812 02:45:16.748909 4117 raft_consensus.cc:2454] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afa61c1031934a3d948a376413d44ae2 in term 1.
I20260812 02:45:16.749035 4483 leader_election.cc:302] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc6f55d632149fb901be88fdbed6447, afa61c1031934a3d948a376413d44ae2; no voters:
I20260812 02:45:16.749266 4750 raft_consensus.cc:2781] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:45:16.749485 4750 raft_consensus.cc:686] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [term 1 LEADER]: Becoming Leader. State: Replica: afa61c1031934a3d948a376413d44ae2, State: Running, Role: LEADER
I20260812 02:45:16.749801 4750 consensus_queue.cc:237] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } }
I20260812 02:45:16.753027 3849 catalog_manager.cc:5495] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 reported cstate change: term changed from 0 to 1, leader changed from <none> to afa61c1031934a3d948a376413d44ae2 (127.10.75.67). New cstate: current_term: 1 leader_uuid: "afa61c1031934a3d948a376413d44ae2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } health_report { overall_health: HEALTHY } } }
I20260812 02:45:16.772634 4734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:16.769020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35262 (local address 127.10.75.67:42245)
0812 02:45:16.769177 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:16.769184 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:16.769201 (+ 17us) server_negotiation.cc:407] Connection header received
0812 02:45:16.769292 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:16.769294 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:16.769347 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:16.769472 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:45:16.769749 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.770320 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.771160 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:16.771380 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:16.771493 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:16.771801 (+ 308us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:45:16.772211 (+ 410us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:45:16.772347 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:16.772410 (+ 63us) server_negotiation.cc:299] Negotiation successful
0812 02:45:16.772464 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 02:45:16.778736 4117 raft_consensus.cc:1261] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Refusing update from remote peer afa61c1031934a3d948a376413d44ae2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:45:16.778749 4352 raft_consensus.cc:1261] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447 [term 1 FOLLOWER]: Refusing update from remote peer afa61c1031934a3d948a376413d44ae2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:45:16.779505 4758 consensus_queue.cc:1035] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:45:16.779696 4750 consensus_queue.cc:1035] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:45:16.786814 4765 mvcc.cc:205] Tried to move back new op lower bound from 7317515127918088192 to 7317515127810007040. Current Snapshot: MvccSnapshot[applied={T|T < 7317515127918088192}]
I20260812 02:45:16.788532 4766 mvcc.cc:205] Tried to move back new op lower bound from 7317515127918088192 to 7317515127810007040. Current Snapshot: MvccSnapshot[applied={T|T < 7317515127918088192}]
I20260812 02:45:16.796330 3850 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:45:16.796486 3850 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:45:16.798985 3850 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073: Sending DeleteTablet for 3 replicas of tablet a6e011beadda477395db37ddef198968
I20260812 02:45:16.799817 4087 tablet_service.cc:1514] Processing DeleteTablet for tablet a6e011beadda477395db37ddef198968 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:45:16 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:36462
I20260812 02:45:16.799907 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 3961
I20260812 02:45:16.799909 4313 tablet_service.cc:1514] Processing DeleteTablet for tablet a6e011beadda477395db37ddef198968 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:45:16 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:40570
I20260812 02:45:16.808907 4777 tablet_replica.cc:330] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447: stopping tablet replica
I20260812 02:45:16.809396 4777 raft_consensus.cc:2229] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:45:16.809839 4777 raft_consensus.cc:2258] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:45:16.813237 4777 ts_tablet_manager.cc:1905] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:45:16.816103 4577 tablet_service.cc:1514] Processing DeleteTablet for tablet a6e011beadda477395db37ddef198968 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:45:16 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:35246
I20260812 02:45:16.816721 4777 ts_tablet_manager.cc:1918] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:45:16.816840 4777 log.cc:1196] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/a6e011beadda477395db37ddef198968
I20260812 02:45:16.817215 4777 ts_tablet_manager.cc:1939] T a6e011beadda477395db37ddef198968 P 8dc6f55d632149fb901be88fdbed6447: Deleting consensus metadata
I20260812 02:45:16.817863 4780 tablet_replica.cc:330] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2: stopping tablet replica
I20260812 02:45:16.818339 4780 raft_consensus.cc:2229] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:45:16.818747 3833 catalog_manager.cc:4841] TS 8dc6f55d632149fb901be88fdbed6447 (127.10.75.66:41775): tablet a6e011beadda477395db37ddef198968 (table test-table [id=17ded880d19a41cb8935b6500273d444]) successfully deleted
I20260812 02:45:16.818944 4780 raft_consensus.cc:2258] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:45:16.820760 4780 ts_tablet_manager.cc:1905] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:45:16.824615 4780 ts_tablet_manager.cc:1918] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260812 02:45:16.824667 3822 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.75.65:42077 (error 108)
I20260812 02:45:16.824733 4780 log.cc:1196] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/a6e011beadda477395db37ddef198968
I20260812 02:45:16.824976 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 4202
I20260812 02:45:16.825096 4780 ts_tablet_manager.cc:1939] T a6e011beadda477395db37ddef198968 P afa61c1031934a3d948a376413d44ae2: Deleting consensus metadata
I20260812 02:45:16.844017 4730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:16.843577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:42077 (local address 127.0.0.1:36474)
0812 02:45:16.843819 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:16.843907 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.65:42077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
W20260812 02:45:16.844383 3822 catalog_manager.cc:4584] TS cd3eeeaec6b8405384ac6f80ba534b2b (127.10.75.65:42077): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a6e011beadda477395db37ddef198968: Network error: Client connection negotiation failed: client connection to 127.10.75.65:42077: connect: Connection refused (error 111)
I20260812 02:45:16.851732 3828 catalog_manager.cc:4841] TS afa61c1031934a3d948a376413d44ae2 (127.10.75.67:42245): tablet a6e011beadda477395db37ddef198968 (table test-table [id=17ded880d19a41cb8935b6500273d444]) successfully deleted
I20260812 02:45:16.859292 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 4445
I20260812 02:45:16.873093 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 3791
I20260812 02:45:16.890175 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:37925
--webserver_interface=127.10.75.126
--webserver_port=42959
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:37925
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:45:17.004627 4784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:17.004956 4784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:17.005033 4784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:17.009176 4784 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:45:17.009279 4784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:17.009316 4784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:17.009356 4784 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:45:17.009390 4784 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:45:17.014933 4784 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:37925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:37925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=42959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:17.016057 4784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:17.017112 4784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:17.031567 4793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:17.031579 4790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:17.031587 4791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:17.031826 4784 server_base.cc:1034] running on GCE node
I20260812 02:45:17.032568 4784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:17.033742 4784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:17.034921 4784 hybrid_clock.cc:648] HybridClock initialized: now 1786502717034905 us; error 26 us; skew 500 ppm
Aug 12 02:45:17 dist-test-slave-2p8l krb5kdc[3772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502717, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:17.037997 4784 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:45:17.038955 4784 webserver.cc:460] Webserver started at http://127.10.75.126:42959/ using document root <none> and password file <none>
I20260812 02:45:17.039572 4784 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:17.039705 4784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:17.043781 4784 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 02:45:17.046027 4805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:17.047418 4784 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 02:45:17.047586 4784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "9028f42d00cf465a89ad9bf32b147073"
format_stamp: "Formatted at 2026-08-12 02:45:15 on dist-test-slave-2p8l"
server_key: "174244640a398db594e132548eddad24"
server_key_iv: "2b603b6e963c2097c7acc11fc822554f"
server_key_version: "encryptionkey@0"
I20260812 02:45:17.048224 4784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:17.079030 4784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:17.082309 4784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:17.082544 4784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:17.090265 4784 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:37925
I20260812 02:45:17.090655 4898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:37925 every 8 connection(s)
I20260812 02:45:17.091475 4784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:45:17.096415 4899 sys_catalog.cc:263] Verifying existing consensus state
I20260812 02:45:17.097800 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 4784
I20260812 02:45:17.098382 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:42077
--local_ip_for_outbound_sockets=127.10.75.65
--tserver_master_addrs=127.10.75.126:37925
--webserver_port=39961
--webserver_interface=127.10.75.65
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:45:17.098662 4899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073: Bootstrap starting.
I20260812 02:45:17.119340 4899 log.cc:824] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:17.129442 4899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 02:45:17.129885 4899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073: Bootstrap complete.
I20260812 02:45:17.134724 4899 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9028f42d00cf465a89ad9bf32b147073" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37925 } }
I20260812 02:45:17.135188 4899 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9028f42d00cf465a89ad9bf32b147073, State: Initialized, Role: FOLLOWER
I20260812 02:45:17.135721 4899 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9028f42d00cf465a89ad9bf32b147073" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37925 } }
I20260812 02:45:17.135882 4899 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:45:17.135989 4899 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:45:17.136132 4899 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 1 FOLLOWER]: Advancing to term 2
I20260812 02:45:17.138270 4899 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9028f42d00cf465a89ad9bf32b147073" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37925 } }
I20260812 02:45:17.138635 4899 leader_election.cc:302] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9028f42d00cf465a89ad9bf32b147073; no voters:
I20260812 02:45:17.139022 4899 leader_election.cc:288] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 02:45:17.139117 4905 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 02:45:17.139356 4905 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 2 LEADER]: Becoming Leader. State: Replica: 9028f42d00cf465a89ad9bf32b147073, State: Running, Role: LEADER
I20260812 02:45:17.139691 4905 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9028f42d00cf465a89ad9bf32b147073" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37925 } }
I20260812 02:45:17.140414 4899 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:45:17.140731 4905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9028f42d00cf465a89ad9bf32b147073. Latest consensus state: current_term: 2 leader_uuid: "9028f42d00cf465a89ad9bf32b147073" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9028f42d00cf465a89ad9bf32b147073" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37925 } } }
I20260812 02:45:17.140864 4905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [sys.catalog]: This master's current role is: LEADER
I20260812 02:45:17.141273 4913 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:45:17.141300 4908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9028f42d00cf465a89ad9bf32b147073" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9028f42d00cf465a89ad9bf32b147073" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37925 } } }
I20260812 02:45:17.141563 4908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [sys.catalog]: This master's current role is: LEADER
I20260812 02:45:17.146613 4913 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:45:17.147332 4913 catalog_manager.cc:1259] Loaded cluster ID: 5ebab4ee51d04a81a3e508066ab29a0b
I20260812 02:45:17.148540 4913 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:45:17.150421 4913 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 02:45:17.155913 4913 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 02:45:17.161993 4913 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:45:17.162896 4913 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073: Loaded TSK: 0
I20260812 02:45:17.164160 4913 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 02:45:17.225459 4903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:17.225802 4903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:17.225888 4903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:17.230247 4903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:17.230332 4903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:17.230418 4903 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:45:17.235889 4903 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:42077
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=39961
--tserver_master_addrs=127.10.75.126:37925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:17.236981 4903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:17.238135 4903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:17.250491 4951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:17.250504 4958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:17.250488 4961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:17.251019 4903 server_base.cc:1034] running on GCE node
I20260812 02:45:17.251559 4903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:17.252290 4903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:17.253486 4903 hybrid_clock.cc:648] HybridClock initialized: now 1786502717253482 us; error 54 us; skew 500 ppm
Aug 12 02:45:17 dist-test-slave-2p8l krb5kdc[3772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502717, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:17.256525 4903 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:45:17.257555 4903 webserver.cc:460] Webserver started at http://127.10.75.65:39961/ using document root <none> and password file <none>
I20260812 02:45:17.258200 4903 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:17.258285 4903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:17.262323 4903 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 02:45:17.264590 4977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:17.265925 4903 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:45:17.266091 4903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "cd3eeeaec6b8405384ac6f80ba534b2b"
format_stamp: "Formatted at 2026-08-12 02:45:16 on dist-test-slave-2p8l"
server_key: "7cd4925d0a2a693c631245e7daa65ae8"
server_key_iv: "cc0dc61a75d057697fd04587dde2543a"
server_key_version: "encryptionkey@0"
I20260812 02:45:17.266649 4903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:17.291790 4903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:17.295300 4903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:17.295516 4903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:17.296188 4903 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:17.297339 4989 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 02:45:17.301786 4903 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 02:45:17.301847 4903 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260812 02:45:17.301921 4903 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 02:45:17.303573 4903 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 02:45:17.303619 4903 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260812 02:45:17.303906 4989 tablet_bootstrap.cc:492] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b: Bootstrap starting.
I20260812 02:45:17.314561 4903 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:42077
I20260812 02:45:17.314669 5186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:42077 every 8 connection(s)
I20260812 02:45:17.315524 4903 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:45:17.317122 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 4903
I20260812 02:45:17.317602 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:41775
--local_ip_for_outbound_sockets=127.10.75.66
--tserver_master_addrs=127.10.75.126:37925
--webserver_port=38523
--webserver_interface=127.10.75.66
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:45:17.323911 4989 log.cc:824] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b: Log is configured to *not* fsync() on all Append() calls
Aug 12 02:45:17 dist-test-slave-2p8l krb5kdc[3772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502717, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:17.332566 4989 tablet_bootstrap.cc:492] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 02:45:17.333043 4989 tablet_bootstrap.cc:492] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b: Bootstrap complete.
I20260812 02:45:17.334507 4989 ts_tablet_manager.cc:1397] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b: Time spent bootstrapping tablet: real 0.031s user 0.022s sys 0.008s
I20260812 02:45:17.337113 5189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:17.317928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:46449 (local address 127.10.75.126:37925)
0812 02:45:17.318763 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:17.318786 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:17.319352 (+ 566us) server_negotiation.cc:407] Connection header received
0812 02:45:17.321011 (+ 1659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:17.321029 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:17.321420 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:17.321798 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:17.323285 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.325076 (+ 1791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.326740 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.327567 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.327788 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:17.331121 (+ 3333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:17.331128 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:17.331144 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:17.331180 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:17.333404 (+ 2224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:17.334099 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:17.334106 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:17.334112 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:17.334271 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:17.334763 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:17.334766 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:17.334768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:17.335209 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:17.335345 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:17.335986 (+ 641us) server_negotiation.cc:299] Negotiation successful
0812 02:45:17.336288 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":145,"threads_started":1}
I20260812 02:45:17.337126 5190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:17.317889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:46449)
0812 02:45:17.319138 (+ 1249us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:17.319197 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:17.320494 (+ 1297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:17.321894 (+ 1400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:17.321903 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:17.322448 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:17.323074 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:17.323096 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.325275 (+ 2179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.325279 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:17.326596 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:17.326608 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.327750 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.327754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:17.327962 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:17.328715 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:17.328735 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:17.330868 (+ 2133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:17.333536 (+ 2668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:17.333542 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:17.333556 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:17.333918 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:17.334388 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:17.334391 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:17.334394 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:17.334559 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:17.335348 (+ 789us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:17.335354 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:17.335638 (+ 284us) client_negotiation.cc:769] Sending connection context
0812 02:45:17.335828 (+ 190us) client_negotiation.cc:240] Negotiation successful
0812 02:45:17.336163 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1011,"thread_start_us":213,"threads_started":1}
I20260812 02:45:17.337325 4989 raft_consensus.cc:348] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } }
I20260812 02:45:17.337872 4989 raft_consensus.cc:729] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd3eeeaec6b8405384ac6f80ba534b2b, State: Initialized, Role: FOLLOWER
I20260812 02:45:17.338423 4989 consensus_queue.cc:260] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } }
I20260812 02:45:17.339320 4989 ts_tablet_manager.cc:1428] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260812 02:45:17.340004 5187 heartbeater.cc:347] Connected to a master server at 127.10.75.126:37925
I20260812 02:45:17.340258 5187 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:17.340745 5187 heartbeater.cc:511] Master 127.10.75.126:37925 requested a full tablet report, sending...
I20260812 02:45:17.343439 4838 ts_manager.cc:194] Registered new tserver with Master: cd3eeeaec6b8405384ac6f80ba534b2b (127.10.75.65:42077)
I20260812 02:45:17.347802 4838 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:46449
I20260812 02:45:17.350195 5187 heartbeater.cc:503] Master 127.10.75.126:37925 was elected leader, sending a full tablet report...
Aug 12 02:45:17 dist-test-slave-2p8l krb5kdc[3772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502717, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for kudu/127.10.75.65@KRBTEST.COM
I20260812 02:45:17.357915 5201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:17.346779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:42077 (local address 127.0.0.1:36476)
0812 02:45:17.347180 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:17.347224 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:17.347349 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:17.348057 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:17.348062 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:17.348417 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:17.348566 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:17.348579 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.350050 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.350054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:17.350850 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:17.350862 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.351489 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.351494 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:17.351606 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:17.352286 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:17.352301 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:17.354019 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:17.355994 (+ 1975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:17.356006 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:17.356011 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:17.356258 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:17.356613 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:17.356616 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:17.356618 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:17.356710 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:17.357199 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:17.357206 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:17.357339 (+ 133us) client_negotiation.cc:769] Sending connection context
0812 02:45:17.357488 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 02:45:17.357729 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":138,"threads_started":1}
I20260812 02:45:17.357952 5204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:17.346825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36476 (local address 127.10.75.65:42077)
0812 02:45:17.347590 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:17.347599 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:17.347618 (+ 19us) server_negotiation.cc:407] Connection header received
0812 02:45:17.347672 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:17.347676 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:17.347818 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:17.348038 (+ 220us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:17.348717 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.349897 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.350983 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.351320 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.351444 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:17.354269 (+ 2825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:17.354279 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:17.354289 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:17.354312 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:17.355866 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:17.356395 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:17.356401 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:17.356402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:17.356490 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:17.356811 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:17.356815 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:17.356817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:17.357072 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:17.357224 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:17.357588 (+ 364us) server_negotiation.cc:299] Negotiation successful
0812 02:45:17.357808 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":660,"thread_start_us":106,"threads_started":1}
I20260812 02:45:17.359668 5061 tablet_service.cc:1514] Processing DeleteTablet for tablet a6e011beadda477395db37ddef198968 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:45:16 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:36476
I20260812 02:45:17.360570 5205 tablet_replica.cc:330] stopping tablet replica
I20260812 02:45:17.360878 5205 raft_consensus.cc:2229] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:45:17.361157 5205 raft_consensus.cc:2258] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:45:17.362212 5205 ts_tablet_manager.cc:1905] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:45:17.365895 5205 ts_tablet_manager.cc:1918] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:45:17.366031 5205 log.cc:1196] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/wal/wals/a6e011beadda477395db37ddef198968
I20260812 02:45:17.366354 5205 ts_tablet_manager.cc:1939] T a6e011beadda477395db37ddef198968 P cd3eeeaec6b8405384ac6f80ba534b2b: Deleting consensus metadata
I20260812 02:45:17.368151 4807 catalog_manager.cc:4841] TS cd3eeeaec6b8405384ac6f80ba534b2b (127.10.75.65:42077): tablet a6e011beadda477395db37ddef198968 (table test-table [id=17ded880d19a41cb8935b6500273d444]) successfully deleted
W20260812 02:45:17.441509 5192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:17.441794 5192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:17.441872 5192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:17.446166 5192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:17.446251 5192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:17.446342 5192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:45:17.451761 5192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:41775
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=38523
--tserver_master_addrs=127.10.75.126:37925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:17.452893 5192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:17.453974 5192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:17.463925 5212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:17.463948 5211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:17.463933 5192 server_base.cc:1034] running on GCE node
W20260812 02:45:17.463953 5218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:17.464535 5192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:17.465180 5192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:17.466382 5192 hybrid_clock.cc:648] HybridClock initialized: now 1786502717466365 us; error 28 us; skew 500 ppm
Aug 12 02:45:17 dist-test-slave-2p8l krb5kdc[3772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502717, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:17.469231 5192 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:45:17.470278 5192 webserver.cc:460] Webserver started at http://127.10.75.66:38523/ using document root <none> and password file <none>
I20260812 02:45:17.470942 5192 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:17.471064 5192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:17.475018 5192 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 02:45:17.477180 5229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:17.478528 5192 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:45:17.478678 5192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "8dc6f55d632149fb901be88fdbed6447"
format_stamp: "Formatted at 2026-08-12 02:45:16 on dist-test-slave-2p8l"
server_key: "c1cf9df979ff503b0c4fe10e1651cd08"
server_key_iv: "cd6d35c4983db4239edb23f49f32eed7"
server_key_version: "encryptionkey@0"
I20260812 02:45:17.479313 5192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:17.490389 5192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:17.493383 5192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:17.493603 5192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:17.494277 5192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:17.495126 5192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:45:17.495208 5192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:17.495283 5192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:45:17.495328 5192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:17.504550 5192 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:41775
I20260812 02:45:17.504580 5435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:41775 every 8 connection(s)
I20260812 02:45:17.505589 5192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:45:17.506031 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 5192
I20260812 02:45:17.506639 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:42245
--local_ip_for_outbound_sockets=127.10.75.67
--tserver_master_addrs=127.10.75.126:37925
--webserver_port=34445
--webserver_interface=127.10.75.67
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 02:45:17 dist-test-slave-2p8l krb5kdc[3772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502717, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:17.522189 5189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:17.507652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:37407 (local address 127.10.75.126:37925)
0812 02:45:17.507844 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:17.507851 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:17.508758 (+ 907us) server_negotiation.cc:407] Connection header received
0812 02:45:17.510292 (+ 1534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:17.510295 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:17.510349 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:17.510416 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:17.512172 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.512727 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.514710 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.514942 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.515021 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:17.518242 (+ 3221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:17.518245 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:17.518247 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:17.518276 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:17.519941 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:17.520526 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:17.520530 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:17.520531 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:17.520615 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:17.520982 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:17.520985 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:17.520987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:17.521176 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:17.521288 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:17.521804 (+ 516us) server_negotiation.cc:299] Negotiation successful
0812 02:45:17.521948 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 02:45:17.523087 5440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:17.508019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:37407)
0812 02:45:17.508565 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:17.508633 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:17.510002 (+ 1369us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:17.510640 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:17.510652 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:17.511208 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:17.511959 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:17.511985 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.512878 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.512885 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:17.514554 (+ 1669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:17.514570 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.515124 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.515132 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:17.515380 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:17.516092 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:17.516121 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:17.517973 (+ 1852us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:17.520098 (+ 2125us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:17.520104 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:17.520120 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:17.520400 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:17.520715 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:17.520718 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:17.520721 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:17.520873 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:17.521287 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:17.521295 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:17.521549 (+ 254us) client_negotiation.cc:769] Sending connection context
0812 02:45:17.521743 (+ 194us) client_negotiation.cc:240] Negotiation successful
0812 02:45:17.522114 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":124,"threads_started":1}
I20260812 02:45:17.524296 5436 heartbeater.cc:347] Connected to a master server at 127.10.75.126:37925
I20260812 02:45:17.524572 5436 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:17.525095 5436 heartbeater.cc:511] Master 127.10.75.126:37925 requested a full tablet report, sending...
I20260812 02:45:17.526221 4838 ts_manager.cc:194] Registered new tserver with Master: 8dc6f55d632149fb901be88fdbed6447 (127.10.75.66:41775)
I20260812 02:45:17.526803 4838 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:37407
W20260812 02:45:17.624706 5441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:17.625000 5441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:17.625075 5441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:17.629079 5441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:17.629169 5441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:17.629264 5441 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:45:17.634598 5441 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:42245
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=34445
--tserver_master_addrs=127.10.75.126:37925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:17.635667 5441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:17.636684 5441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:17.646337 5451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:17.646358 5453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:17.646404 5456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:17.646504 5441 server_base.cc:1034] running on GCE node
I20260812 02:45:17.647001 5441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:17.647665 5441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:17.648828 5441 hybrid_clock.cc:648] HybridClock initialized: now 1786502717648800 us; error 40 us; skew 500 ppm
Aug 12 02:45:17 dist-test-slave-2p8l krb5kdc[3772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502717, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:17.652243 5441 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:45:17.653246 5441 webserver.cc:460] Webserver started at http://127.10.75.67:34445/ using document root <none> and password file <none>
I20260812 02:45:17.653820 5441 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:17.653899 5441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:17.657810 5441 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:45:17.660147 5475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:17.661397 5441 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260812 02:45:17.661526 5441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "afa61c1031934a3d948a376413d44ae2"
format_stamp: "Formatted at 2026-08-12 02:45:16 on dist-test-slave-2p8l"
server_key: "3d3ca374255fb9a9d31eb5c07a88cdb0"
server_key_iv: "4247c53be28e9acad10f42028e01476c"
server_key_version: "encryptionkey@0"
I20260812 02:45:17.662114 5441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:17.682165 5441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:17.685477 5441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:17.685689 5441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:17.686334 5441 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:17.687182 5441 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:45:17.687232 5441 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:17.687304 5441 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:45:17.687346 5441 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:17.696154 5441 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:42245
I20260812 02:45:17.696190 5699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:42245 every 8 connection(s)
I20260812 02:45:17.697248 5441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:45:17.705499 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 5441
Aug 12 02:45:17 dist-test-slave-2p8l krb5kdc[3772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502717, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:17.712374 5189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:17.699173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:36479 (local address 127.10.75.126:37925)
0812 02:45:17.699396 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:17.699400 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:17.700188 (+ 788us) server_negotiation.cc:407] Connection header received
0812 02:45:17.701553 (+ 1365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:17.701556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:17.701610 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:17.701685 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:17.702882 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.703413 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.704527 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.704757 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.704835 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:17.708062 (+ 3227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:17.708067 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:17.708070 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:17.708101 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:17.709780 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:17.710634 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:17.710639 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:17.710641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:17.710736 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:17.711113 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:17.711117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:17.711118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:17.711307 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:17.711432 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:17.712140 (+ 708us) server_negotiation.cc:299] Negotiation successful
0812 02:45:17.712248 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
I20260812 02:45:17.713656 5704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:17.699543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:36479)
0812 02:45:17.700025 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:17.700066 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:17.701344 (+ 1278us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:17.701862 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:17.701868 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:17.702236 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:17.702735 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:17.702749 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.703547 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.703550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:17.704403 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:17.704412 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.704894 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.704897 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:17.705038 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:17.705821 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:17.705841 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:17.707896 (+ 2055us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:17.710039 (+ 2143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:17.710045 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:17.710191 (+ 146us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:17.710505 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:17.710846 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:17.710853 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:17.710855 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:17.710994 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:17.711457 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:17.711463 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:17.711827 (+ 364us) client_negotiation.cc:769] Sending connection context
0812 02:45:17.712068 (+ 241us) client_negotiation.cc:240] Negotiation successful
0812 02:45:17.712449 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":119,"threads_started":1}
I20260812 02:45:17.714928 5700 heartbeater.cc:347] Connected to a master server at 127.10.75.126:37925
I20260812 02:45:17.715198 5700 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:17.715716 5700 heartbeater.cc:511] Master 127.10.75.126:37925 requested a full tablet report, sending...
I20260812 02:45:17.716064 5712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:17.706344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40896 (local address 127.10.75.126:37925)
0812 02:45:17.706655 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:17.706658 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:17.706714 (+ 56us) server_negotiation.cc:407] Connection header received
0812 02:45:17.706892 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:17.706897 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:17.706992 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:17.707116 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:17.708168 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.708870 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.710396 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.710724 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.711028 (+ 304us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:17.712631 (+ 1603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:17.712635 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:17.712638 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:17.712662 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:17.714387 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:17.714827 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:17.714832 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:17.714834 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:17.714919 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:17.715216 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:17.715221 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:17.715223 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:17.715415 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:17.715630 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:17.715781 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 02:45:17.715905 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":103,"threads_started":1}
I20260812 02:45:17.716939 4838 ts_manager.cc:194] Registered new tserver with Master: afa61c1031934a3d948a376413d44ae2 (127.10.75.67:42245)
I20260812 02:45:17.717530 4838 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:36479
I20260812 02:45:17.718000 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:45:17.722316 5712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:17.718829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40908 (local address 127.10.75.126:37925)
0812 02:45:17.718942 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:17.718946 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:17.718985 (+ 39us) server_negotiation.cc:407] Connection header received
0812 02:45:17.719138 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:17.719140 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:17.719219 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:17.719297 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:45:17.719568 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.720060 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.720937 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.721154 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.721232 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:17.721535 (+ 303us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:45:17.721882 (+ 347us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:45:17.721967 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:17.722131 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 02:45:17.722188 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 02:45:17.722899 4838 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:40908:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:45:17.726302 4838 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:45:17.733865 5061 tablet_service.cc:1467] Processing CreateTablet for tablet b79080c6160643c09d0d995d3a422e5f (DEFAULT_TABLE table=test-table [id=1a4dbff9094b4c959f3d6e67c9567d3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:45:17.734607 5061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b79080c6160643c09d0d995d3a422e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:17.737459 4989 tablet_bootstrap.cc:492] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b: Bootstrap starting.
I20260812 02:45:17.738374 4989 tablet_bootstrap.cc:654] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:17.738901 5721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:17.732983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:41775 (local address 127.0.0.1:40576)
0812 02:45:17.734304 (+ 1321us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:17.734318 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:17.734420 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:17.734881 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:17.734884 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:17.734904 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:17.734997 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:17.735002 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.736316 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.736320 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:17.737238 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:17.737246 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.738464 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.738468 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:17.738550 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:17.738593 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 02:45:17.738677 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 02:45:17.738748 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1259,"thread_start_us":141,"threads_started":1}
I20260812 02:45:17.738955 5726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:17.733224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40576 (local address 127.10.75.66:41775)
0812 02:45:17.733579 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:17.733592 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:17.734418 (+ 826us) server_negotiation.cc:407] Connection header received
0812 02:45:17.734529 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:17.734534 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:17.734736 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:17.734883 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:17.735120 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.736164 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.737355 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.738336 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.738453 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:17.738606 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:17.738707 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 02:45:17.738814 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":111,"threads_started":1}
I20260812 02:45:17.739863 4989 tablet_bootstrap.cc:492] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b: No bootstrap required, opened a new log
I20260812 02:45:17.739964 4989 ts_tablet_manager.cc:1397] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 02:45:17.740425 4989 raft_consensus.cc:348] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } }
I20260812 02:45:17.740546 4989 raft_consensus.cc:374] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:17.740603 4989 raft_consensus.cc:729] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd3eeeaec6b8405384ac6f80ba534b2b, State: Initialized, Role: FOLLOWER
I20260812 02:45:17.740772 5201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:17.732681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:42245 (local address 127.0.0.1:35276)
0812 02:45:17.732817 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:17.732835 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:17.732914 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:17.734200 (+ 1286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:17.734206 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:17.734230 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:17.734340 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:17.734350 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.735745 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.735750 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:17.736774 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:17.736785 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.740371 (+ 3586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.740375 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:17.740468 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:17.740489 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 02:45:17.740572 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 02:45:17.740651 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 02:45:17.740757 4989 consensus_queue.cc:260] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } }
I20260812 02:45:17.741003 4989 ts_tablet_manager.cc:1428] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 02:45:17.741230 5723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:17.732995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35276 (local address 127.10.75.67:42245)
0812 02:45:17.733660 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:17.733672 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:17.733696 (+ 24us) server_negotiation.cc:407] Connection header received
0812 02:45:17.733773 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:17.733779 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:17.733994 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:17.734184 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:17.734482 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.735610 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.736924 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.740250 (+ 3326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.740371 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:17.740501 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:17.740740 (+ 239us) server_negotiation.cc:299] Negotiation successful
0812 02:45:17.741020 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":193,"threads_started":1}
I20260812 02:45:17.742226 5318 tablet_service.cc:1467] Processing CreateTablet for tablet b79080c6160643c09d0d995d3a422e5f (DEFAULT_TABLE table=test-table [id=1a4dbff9094b4c959f3d6e67c9567d3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:45:17.743333 5318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b79080c6160643c09d0d995d3a422e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:17.744550 5574 tablet_service.cc:1467] Processing CreateTablet for tablet b79080c6160643c09d0d995d3a422e5f (DEFAULT_TABLE table=test-table [id=1a4dbff9094b4c959f3d6e67c9567d3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:45:17.745368 5574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b79080c6160643c09d0d995d3a422e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:17.749687 5729 tablet_bootstrap.cc:492] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447: Bootstrap starting.
I20260812 02:45:17.751665 5735 tablet_bootstrap.cc:492] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2: Bootstrap starting.
I20260812 02:45:17.753230 5729 tablet_bootstrap.cc:654] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:17.753732 5735 tablet_bootstrap.cc:654] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:17.754181 5729 log.cc:824] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:17.754840 5735 log.cc:824] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:17.755949 5729 tablet_bootstrap.cc:492] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447: No bootstrap required, opened a new log
I20260812 02:45:17.756174 5729 ts_tablet_manager.cc:1397] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260812 02:45:17.756546 5735 tablet_bootstrap.cc:492] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2: No bootstrap required, opened a new log
I20260812 02:45:17.756735 5735 ts_tablet_manager.cc:1397] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 02:45:17.759498 5729 raft_consensus.cc:348] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } }
I20260812 02:45:17.759703 5729 raft_consensus.cc:374] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:17.759737 5729 raft_consensus.cc:729] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc6f55d632149fb901be88fdbed6447, State: Initialized, Role: FOLLOWER
I20260812 02:45:17.759716 5735 raft_consensus.cc:348] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } }
I20260812 02:45:17.759982 5735 raft_consensus.cc:374] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:17.760044 5735 raft_consensus.cc:729] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afa61c1031934a3d948a376413d44ae2, State: Initialized, Role: FOLLOWER
I20260812 02:45:17.760231 5729 consensus_queue.cc:260] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } }
I20260812 02:45:17.760458 5735 consensus_queue.cc:260] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } }
I20260812 02:45:17.760883 5436 heartbeater.cc:503] Master 127.10.75.126:37925 was elected leader, sending a full tablet report...
I20260812 02:45:17.761144 5729 ts_tablet_manager.cc:1428] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 02:45:17.761377 5735 ts_tablet_manager.cc:1428] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 02:45:17.761641 5700 heartbeater.cc:503] Master 127.10.75.126:37925 was elected leader, sending a full tablet report...
W20260812 02:45:17.816757 5188 tablet.cc:2369] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:45:17.913090 5740 raft_consensus.cc:482] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:45:17.913311 5740 raft_consensus.cc:504] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } }
I20260812 02:45:17.914690 5740 leader_election.cc:288] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afa61c1031934a3d948a376413d44ae2 (127.10.75.67:42245), cd3eeeaec6b8405384ac6f80ba534b2b (127.10.75.65:42077)
I20260812 02:45:17.920192 5723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:17.915151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:53869 (local address 127.10.75.67:42245)
0812 02:45:17.915273 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:17.915278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:17.915622 (+ 344us) server_negotiation.cc:407] Connection header received
0812 02:45:17.915688 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:17.915693 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:17.915749 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:17.915821 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:17.916087 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.916864 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.918866 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.919468 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.919651 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:17.919715 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:17.919971 (+ 256us) server_negotiation.cc:299] Negotiation successful
0812 02:45:17.920048 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 02:45:17.920193 5742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:17.915087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:60659 (local address 127.10.75.65:42077)
0812 02:45:17.915464 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:17.915467 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:17.915480 (+ 13us) server_negotiation.cc:407] Connection header received
0812 02:45:17.915528 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:17.915530 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:17.915620 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:17.915737 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:17.916065 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.916865 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.918866 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.919598 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.919715 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:17.919865 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:17.919969 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 02:45:17.920059 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":134,"threads_started":1}
I20260812 02:45:17.920212 5440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:17.915020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:42077 (local address 127.10.75.66:60659)
0812 02:45:17.915185 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:17.915201 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:17.915309 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:17.915750 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:17.915752 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:17.915763 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:17.915908 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:17.915914 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.917008 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.917013 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:17.918695 (+ 1682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:17.918702 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.919719 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.919722 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:17.919840 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:17.919857 (+ 17us) client_negotiation.cc:769] Sending connection context
0812 02:45:17.919930 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 02:45:17.920049 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72,"mutex_wait_us":202}
I20260812 02:45:17.920224 5744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:17.915035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:42245 (local address 127.10.75.66:53869)
0812 02:45:17.915503 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:17.915515 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:17.915611 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:17.915857 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:17.915859 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:17.915877 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:17.915977 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:17.915984 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.917008 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.917013 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:17.918682 (+ 1669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:17.918697 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.919645 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.919670 (+ 25us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:17.919781 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:17.919841 (+ 60us) client_negotiation.cc:769] Sending connection context
0812 02:45:17.919930 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 02:45:17.920048 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"mutex_wait_us":375,"thread_start_us":96,"threads_started":1}
I20260812 02:45:17.921044 5093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b79080c6160643c09d0d995d3a422e5f" candidate_uuid: "8dc6f55d632149fb901be88fdbed6447" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" is_pre_election: true
I20260812 02:45:17.921126 5620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b79080c6160643c09d0d995d3a422e5f" candidate_uuid: "8dc6f55d632149fb901be88fdbed6447" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afa61c1031934a3d948a376413d44ae2" is_pre_election: true
I20260812 02:45:17.921432 5093 raft_consensus.cc:2454] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc6f55d632149fb901be88fdbed6447 in term 0.
I20260812 02:45:17.921432 5620 raft_consensus.cc:2454] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc6f55d632149fb901be88fdbed6447 in term 0.
I20260812 02:45:17.921979 5233 leader_election.cc:302] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 8dc6f55d632149fb901be88fdbed6447, afa61c1031934a3d948a376413d44ae2, cd3eeeaec6b8405384ac6f80ba534b2b; no voters:
I20260812 02:45:17.922358 5740 raft_consensus.cc:2781] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:45:17.922469 5740 raft_consensus.cc:482] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:45:17.922542 5740 raft_consensus.cc:3037] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:17.923693 5740 raft_consensus.cc:504] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } }
I20260812 02:45:17.924090 5740 leader_election.cc:288] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [CANDIDATE]: Term 1 election: Requested vote from peers afa61c1031934a3d948a376413d44ae2 (127.10.75.67:42245), cd3eeeaec6b8405384ac6f80ba534b2b (127.10.75.65:42077)
I20260812 02:45:17.924628 5620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b79080c6160643c09d0d995d3a422e5f" candidate_uuid: "8dc6f55d632149fb901be88fdbed6447" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afa61c1031934a3d948a376413d44ae2"
I20260812 02:45:17.924762 5093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b79080c6160643c09d0d995d3a422e5f" candidate_uuid: "8dc6f55d632149fb901be88fdbed6447" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b"
I20260812 02:45:17.924803 5620 raft_consensus.cc:3037] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:17.924949 5093 raft_consensus.cc:3037] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:17.926337 5093 raft_consensus.cc:2454] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc6f55d632149fb901be88fdbed6447 in term 1.
I20260812 02:45:17.926337 5620 raft_consensus.cc:2454] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc6f55d632149fb901be88fdbed6447 in term 1.
I20260812 02:45:17.926708 5233 leader_election.cc:302] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc6f55d632149fb901be88fdbed6447, afa61c1031934a3d948a376413d44ae2; no voters:
I20260812 02:45:17.926901 5740 raft_consensus.cc:2781] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:45:17.927162 5740 raft_consensus.cc:686] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc6f55d632149fb901be88fdbed6447, State: Running, Role: LEADER
I20260812 02:45:17.927567 5740 consensus_queue.cc:237] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } }
I20260812 02:45:17.930858 4838 catalog_manager.cc:5495] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc6f55d632149fb901be88fdbed6447 (127.10.75.66). New cstate: current_term: 1 leader_uuid: "8dc6f55d632149fb901be88fdbed6447" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } health_report { overall_health: UNKNOWN } } }
W20260812 02:45:17.948331 5703 tablet.cc:2369] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:45:17.987491 5726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:17.983986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40578 (local address 127.10.75.66:41775)
0812 02:45:17.984118 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:17.984123 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:17.984165 (+ 42us) server_negotiation.cc:407] Connection header received
0812 02:45:17.984242 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:17.984244 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:17.984303 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:17.984388 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:45:17.984719 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.985212 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.986019 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:17.986245 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:17.986322 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:17.986632 (+ 310us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:45:17.987059 (+ 427us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:45:17.987164 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:17.987222 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 02:45:17.987277 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 02:45:17.993767 5620 raft_consensus.cc:1261] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2 [term 1 FOLLOWER]: Refusing update from remote peer 8dc6f55d632149fb901be88fdbed6447: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:45:17.993764 5093 raft_consensus.cc:1261] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Refusing update from remote peer 8dc6f55d632149fb901be88fdbed6447: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:45:17.994527 5740 consensus_queue.cc:1035] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:45:17.994725 5745 consensus_queue.cc:1035] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:45:18.001121 5753 mvcc.cc:205] Tried to move back new op lower bound from 7317515132894334976 to 7317515132634075136. Current Snapshot: MvccSnapshot[applied={T|T < 7317515132894334976}]
I20260812 02:45:18.001740 5754 mvcc.cc:205] Tried to move back new op lower bound from 7317515132894334976 to 7317515132634075136. Current Snapshot: MvccSnapshot[applied={T|T < 7317515132894334976}]
I20260812 02:45:18.009337 4836 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:40908:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:45:18.009527 4836 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:40908:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:45:18.012022 4836 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073: Sending DeleteTablet for 3 replicas of tablet b79080c6160643c09d0d995d3a422e5f
I20260812 02:45:18.012810 5318 tablet_service.cc:1514] Processing DeleteTablet for tablet b79080c6160643c09d0d995d3a422e5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:45:18 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:40576
I20260812 02:45:18.012949 5061 tablet_service.cc:1514] Processing DeleteTablet for tablet b79080c6160643c09d0d995d3a422e5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:45:18 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:36476
I20260812 02:45:18.013365 5771 tablet_replica.cc:330] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b: stopping tablet replica
I20260812 02:45:18.013430 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 4903
I20260812 02:45:18.013372 5574 tablet_service.cc:1514] Processing DeleteTablet for tablet b79080c6160643c09d0d995d3a422e5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:45:18 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:35276
I20260812 02:45:18.013509 5771 raft_consensus.cc:2229] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:45:18.013635 5771 raft_consensus.cc:2258] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:45:18.013861 5772 tablet_replica.cc:330] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447: stopping tablet replica
I20260812 02:45:18.014158 5772 raft_consensus.cc:2229] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:45:18.014458 5772 raft_consensus.cc:2258] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:45:18.016836 5773 tablet_replica.cc:330] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2: stopping tablet replica
I20260812 02:45:18.017107 5773 raft_consensus.cc:2229] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:45:18.017369 5773 raft_consensus.cc:2258] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:45:18.022176 5773 ts_tablet_manager.cc:1905] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:45:18.022495 5772 ts_tablet_manager.cc:1905] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:45:18.026587 5772 ts_tablet_manager.cc:1918] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:45:18.026733 5772 log.cc:1196] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/b79080c6160643c09d0d995d3a422e5f
I20260812 02:45:18.027216 5772 ts_tablet_manager.cc:1939] T b79080c6160643c09d0d995d3a422e5f P 8dc6f55d632149fb901be88fdbed6447: Deleting consensus metadata
I20260812 02:45:18.029044 4813 catalog_manager.cc:4841] TS 8dc6f55d632149fb901be88fdbed6447 (127.10.75.66:41775): tablet b79080c6160643c09d0d995d3a422e5f (table test-table [id=1a4dbff9094b4c959f3d6e67c9567d3b]) successfully deleted
I20260812 02:45:18.036149 5773 ts_tablet_manager.cc:1918] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:45:18.036338 5773 log.cc:1196] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/b79080c6160643c09d0d995d3a422e5f
I20260812 02:45:18.036791 5773 ts_tablet_manager.cc:1939] T b79080c6160643c09d0d995d3a422e5f P afa61c1031934a3d948a376413d44ae2: Deleting consensus metadata
I20260812 02:45:18.038427 4811 catalog_manager.cc:4841] TS afa61c1031934a3d948a376413d44ae2 (127.10.75.67:42245): tablet b79080c6160643c09d0d995d3a422e5f (table test-table [id=1a4dbff9094b4c959f3d6e67c9567d3b]) successfully deleted
W20260812 02:45:18.043087 4807 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.75.65:42077 (error 108)
I20260812 02:45:18.043756 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 5192
I20260812 02:45:18.044611 5201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:18.044067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:42077 (local address 127.0.0.1:36484)
0812 02:45:18.044413 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:18.044490 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.65:42077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235}
W20260812 02:45:18.047055 4807 catalog_manager.cc:4584] TS cd3eeeaec6b8405384ac6f80ba534b2b (127.10.75.65:42077): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b79080c6160643c09d0d995d3a422e5f: Network error: Client connection negotiation failed: client connection to 127.10.75.65:42077: connect: Connection refused (error 111)
I20260812 02:45:18.056977 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 5441
I20260812 02:45:18.074357 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 4784
I20260812 02:45:18.085294 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:37925
--webserver_interface=127.10.75.126
--webserver_port=42959
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:37925
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:45:18.197669 5776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:18.197938 5776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:18.197978 5776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:18.202018 5776 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:45:18.202132 5776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:18.202167 5776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:18.202189 5776 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:45:18.202205 5776 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:45:18.207554 5776 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:37925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:37925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=42959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5776
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:18.208570 5776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:18.209570 5776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:18.218037 5787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:18.218129 5783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:18.218047 5782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:18.218286 5776 server_base.cc:1034] running on GCE node
I20260812 02:45:18.218947 5776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:18.220078 5776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:18.221247 5776 hybrid_clock.cc:648] HybridClock initialized: now 1786502718221224 us; error 43 us; skew 500 ppm
Aug 12 02:45:18 dist-test-slave-2p8l krb5kdc[3772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502718, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:18.224155 5776 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:45:18.225155 5776 webserver.cc:460] Webserver started at http://127.10.75.126:42959/ using document root <none> and password file <none>
I20260812 02:45:18.225678 5776 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:18.225739 5776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:18.229594 5776 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:45:18.231832 5800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:18.233059 5776 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:45:18.233210 5776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "9028f42d00cf465a89ad9bf32b147073"
format_stamp: "Formatted at 2026-08-12 02:45:15 on dist-test-slave-2p8l"
server_key: "174244640a398db594e132548eddad24"
server_key_iv: "2b603b6e963c2097c7acc11fc822554f"
server_key_version: "encryptionkey@0"
I20260812 02:45:18.234038 5776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:18.255295 5776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:18.258335 5776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:18.258551 5776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:18.266125 5776 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:37925
I20260812 02:45:18.266430 5896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:37925 every 8 connection(s)
I20260812 02:45:18.267280 5776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:45:18.271559 5897 sys_catalog.cc:263] Verifying existing consensus state
I20260812 02:45:18.272204 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 5776
I20260812 02:45:18.272626 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:42077
--local_ip_for_outbound_sockets=127.10.75.65
--tserver_master_addrs=127.10.75.126:37925
--webserver_port=39961
--webserver_interface=127.10.75.65
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:45:18.273402 5897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073: Bootstrap starting.
I20260812 02:45:18.292292 5897 log.cc:824] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:18.304071 5897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 02:45:18.304481 5897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073: Bootstrap complete.
I20260812 02:45:18.308684 5897 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9028f42d00cf465a89ad9bf32b147073" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37925 } }
I20260812 02:45:18.309096 5897 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9028f42d00cf465a89ad9bf32b147073, State: Initialized, Role: FOLLOWER
I20260812 02:45:18.309587 5897 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9028f42d00cf465a89ad9bf32b147073" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37925 } }
I20260812 02:45:18.309736 5897 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:45:18.309827 5897 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:45:18.309985 5897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 2 FOLLOWER]: Advancing to term 3
I20260812 02:45:18.311892 5897 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9028f42d00cf465a89ad9bf32b147073" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37925 } }
I20260812 02:45:18.312237 5897 leader_election.cc:302] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9028f42d00cf465a89ad9bf32b147073; no voters:
I20260812 02:45:18.312603 5897 leader_election.cc:288] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 02:45:18.312705 5905 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 02:45:18.312911 5905 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [term 3 LEADER]: Becoming Leader. State: Replica: 9028f42d00cf465a89ad9bf32b147073, State: Running, Role: LEADER
I20260812 02:45:18.313212 5905 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9028f42d00cf465a89ad9bf32b147073" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37925 } }
I20260812 02:45:18.313872 5897 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:45:18.314206 5905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9028f42d00cf465a89ad9bf32b147073. Latest consensus state: current_term: 3 leader_uuid: "9028f42d00cf465a89ad9bf32b147073" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9028f42d00cf465a89ad9bf32b147073" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37925 } } }
I20260812 02:45:18.314334 5905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [sys.catalog]: This master's current role is: LEADER
I20260812 02:45:18.314724 5908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "9028f42d00cf465a89ad9bf32b147073" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9028f42d00cf465a89ad9bf32b147073" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37925 } } }
I20260812 02:45:18.314890 5908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9028f42d00cf465a89ad9bf32b147073 [sys.catalog]: This master's current role is: LEADER
I20260812 02:45:18.316041 5912 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:45:18.321725 5912 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:45:18.322453 5912 catalog_manager.cc:1259] Loaded cluster ID: 5ebab4ee51d04a81a3e508066ab29a0b
I20260812 02:45:18.322563 5912 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 02:45:18.323709 5912 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fe6f542c9ad google::LogMessage::Fail() at ??:0
@ 0x7fe6f542f88a google::LogMessage::SendToLog() at ??:0
@ 0x7fe6f542c4de google::LogMessage::Flush() at ??:0
@ 0x7fe6f542da19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fe6ffd6bfdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fe6ffd6cd2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fe6ffd69579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fe6ffdad640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fe6f767e3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fe6f767ec83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fe6f76803f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fe6f766f512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fe6f8cb36db start_thread at ??:0
@ 0x7fe6f3f2a61f clone at ??:0
W20260812 02:45:18.427616 5900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:18.428000 5900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:18.428128 5900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:18.434464 5900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:18.434544 5900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:18.434633 5900 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:45:18.442495 5900 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:42077
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=39961
--tserver_master_addrs=127.10.75.126:37925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:18.443861 5900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:18.445346 5900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:18.456722 5974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:18.456866 5900 server_base.cc:1034] running on GCE node
W20260812 02:45:18.456763 5978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:18.457003 5972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:18.457482 5900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:18.458420 5900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:18.459638 5900 hybrid_clock.cc:648] HybridClock initialized: now 1786502718459595 us; error 60 us; skew 500 ppm
Aug 12 02:45:18 dist-test-slave-2p8l krb5kdc[3772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502718, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:18.463726 5900 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:45:18.464655 5900 webserver.cc:460] Webserver started at http://127.10.75.65:39961/ using document root <none> and password file <none>
I20260812 02:45:18.465243 5900 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:18.465307 5900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:18.469334 5900 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 02:45:18.471779 5990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:18.473129 5900 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 02:45:18.473272 5900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "cd3eeeaec6b8405384ac6f80ba534b2b"
format_stamp: "Formatted at 2026-08-12 02:45:16 on dist-test-slave-2p8l"
server_key: "7cd4925d0a2a693c631245e7daa65ae8"
server_key_iv: "cc0dc61a75d057697fd04587dde2543a"
server_key_version: "encryptionkey@0"
I20260812 02:45:18.473861 5900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:18.484577 5900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:18.488082 5900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:18.488291 5900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:18.488896 5900 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:18.490049 6000 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 02:45:18.496012 5900 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 02:45:18.496105 5900 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260812 02:45:18.496196 5900 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 02:45:18.497912 5900 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 02:45:18.497985 5900 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260812 02:45:18.498329 6000 tablet_bootstrap.cc:492] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b: Bootstrap starting.
I20260812 02:45:18.509693 5900 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:42077
I20260812 02:45:18.509878 6194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:42077 every 8 connection(s)
I20260812 02:45:18.510869 5900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:45:18.521111 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 5900
I20260812 02:45:18.521544 6000 log.cc:824] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:18.521733 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:41775
--local_ip_for_outbound_sockets=127.10.75.66
--tserver_master_addrs=127.10.75.126:37925
--webserver_port=38523
--webserver_interface=127.10.75.66
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:45:18.531095 6000 tablet_bootstrap.cc:492] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 02:45:18.531558 6000 tablet_bootstrap.cc:492] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b: Bootstrap complete.
I20260812 02:45:18.533147 6000 ts_tablet_manager.cc:1397] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b: Time spent bootstrapping tablet: real 0.035s user 0.020s sys 0.011s
I20260812 02:45:18.536689 6000 raft_consensus.cc:348] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } }
I20260812 02:45:18.537259 6000 raft_consensus.cc:729] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd3eeeaec6b8405384ac6f80ba534b2b, State: Initialized, Role: FOLLOWER
I20260812 02:45:18.537806 6000 consensus_queue.cc:260] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } }
I20260812 02:45:18.538947 6000 ts_tablet_manager.cc:1428] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b: Time spent starting tablet: real 0.006s user 0.004s sys 0.004s
W20260812 02:45:18.586670 6198 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:45:18.512963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:53961)
0812 02:45:18.513480 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:18.513533 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:18.514422 (+ 889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:18.585795 (+ 71373us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":150,"threads_started":1}
W20260812 02:45:18.587186 6196 heartbeater.cc:644] Failed to heartbeat to 127.10.75.126:37925 (0 consecutive failures): Network error: Failed to ping master at 127.10.75.126:37925: Client connection negotiation failed: client connection to 127.10.75.126:37925: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 02:45:18.587973 6198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:18.587722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:33129)
0812 02:45:18.587854 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:18.587917 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 02:45:18.588726 6198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:18.588519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:38017)
0812 02:45:18.588620 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:18.588662 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260812 02:45:18.588970 6196 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 02:45:18.650998 6203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:18.651266 6203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:18.651343 6203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:18.655736 6203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:18.655798 6203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:18.655906 6203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:45:18.661228 6203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:41775
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=38523
--tserver_master_addrs=127.10.75.126:37925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:18.662388 6203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:18.663450 6203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 02:45:18.673713 6203 server_base.cc:1034] running on GCE node
W20260812 02:45:18.673775 6217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:18.673775 6219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:18.673828 6214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:18.674466 6203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:18.675163 6203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:18.676380 6203 hybrid_clock.cc:648] HybridClock initialized: now 1786502718676350 us; error 40 us; skew 500 ppm
Aug 12 02:45:18 dist-test-slave-2p8l krb5kdc[3772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502718, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:18.679544 6203 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:45:18.680586 6203 webserver.cc:460] Webserver started at http://127.10.75.66:38523/ using document root <none> and password file <none>
I20260812 02:45:18.681228 6203 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:18.681337 6203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:18.685781 6203 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 02:45:18.688108 6234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:18.689363 6203 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260812 02:45:18.689512 6203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "8dc6f55d632149fb901be88fdbed6447"
format_stamp: "Formatted at 2026-08-12 02:45:16 on dist-test-slave-2p8l"
server_key: "c1cf9df979ff503b0c4fe10e1651cd08"
server_key_iv: "cd6d35c4983db4239edb23f49f32eed7"
server_key_version: "encryptionkey@0"
I20260812 02:45:18.690196 6203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:18.701901 6203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:18.704981 6203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:18.705200 6203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:18.705838 6203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:18.706743 6203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:45:18.706818 6203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:18.706895 6203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:45:18.706938 6203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:18.716399 6203 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:41775
I20260812 02:45:18.716427 6431 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:41775 every 8 connection(s)
I20260812 02:45:18.717396 6203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:45:18.721508 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 6203
I20260812 02:45:18.721524 6436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:18.719689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:45987)
0812 02:45:18.720172 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:18.720291 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":121,"threads_started":1}
W20260812 02:45:18.721975 6433 heartbeater.cc:644] Failed to heartbeat to 127.10.75.126:37925 (0 consecutive failures): Network error: Failed to ping master at 127.10.75.126:37925: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
I20260812 02:45:18.722008 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:42245
--local_ip_for_outbound_sockets=127.10.75.67
--tserver_master_addrs=127.10.75.126:37925
--webserver_port=34445
--webserver_interface=127.10.75.67
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:36945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:45:18.722643 6436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:18.722424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:43939)
0812 02:45:18.722540 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:18.722588 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 02:45:18.723279 6436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:18.723070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:34181)
0812 02:45:18.723175 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:18.723231 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 02:45:18.723440 6433 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 02:45:18.841465 6437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:18.841765 6437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:18.841809 6437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:18.845994 6437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:18.846079 6437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:18.846176 6437 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:45:18.851759 6437 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:36945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:42245
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=34445
--tserver_master_addrs=127.10.75.126:37925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:18.852870 6437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:18.853917 6437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:18.863947 6448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:18.863947 6445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:18.863991 6437 server_base.cc:1034] running on GCE node
W20260812 02:45:18.863955 6446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:18.864589 6437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:18.865279 6437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:18.866454 6437 hybrid_clock.cc:648] HybridClock initialized: now 1786502718866435 us; error 31 us; skew 500 ppm
Aug 12 02:45:18 dist-test-slave-2p8l krb5kdc[3772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502718, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:18.869190 6437 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:45:18.870198 6437 webserver.cc:460] Webserver started at http://127.10.75.67:34445/ using document root <none> and password file <none>
I20260812 02:45:18.870726 6437 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:18.870788 6437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:18.874584 6437 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260812 02:45:18.876688 6463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:18.878005 6437 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:45:18.878207 6437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "afa61c1031934a3d948a376413d44ae2"
format_stamp: "Formatted at 2026-08-12 02:45:16 on dist-test-slave-2p8l"
server_key: "3d3ca374255fb9a9d31eb5c07a88cdb0"
server_key_iv: "4247c53be28e9acad10f42028e01476c"
server_key_version: "encryptionkey@0"
I20260812 02:45:18.878809 6437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:18.903324 6437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:18.906652 6437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:18.906867 6437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:18.907510 6437 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:18.908404 6437 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:45:18.908478 6437 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:18.908553 6437 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:45:18.908603 6437 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:18.918305 6437 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:42245
I20260812 02:45:18.918381 6661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:42245 every 8 connection(s)
I20260812 02:45:18.919343 6437 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:45:18.920327 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 6437
I20260812 02:45:18.923483 6669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:18.921682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:36327)
0812 02:45:18.922206 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:18.922323 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":117,"threads_started":1}
W20260812 02:45:18.923926 6664 heartbeater.cc:644] Failed to heartbeat to 127.10.75.126:37925 (0 consecutive failures): Network error: Failed to ping master at 127.10.75.126:37925: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
I20260812 02:45:18.924587 6669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:18.924349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:56501)
0812 02:45:18.924468 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:18.924532 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 02:45:18.925196 6669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:18.924984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:42687)
0812 02:45:18.925091 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:18.925137 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 02:45:18.925383 6664 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 02:45:19.590214 6670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:19.589639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:39843)
0812 02:45:19.589915 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:19.589977 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":84,"threads_started":1}
I20260812 02:45:19.724412 6672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:19.723991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:59595)
0812 02:45:19.724251 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:19.724311 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":70,"threads_started":1}
I20260812 02:45:19.926395 6674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:19.925940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:55343)
0812 02:45:19.926236 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:19.926289 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":73,"threads_started":1}
I20260812 02:45:20.401492 6675 raft_consensus.cc:482] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:45:20.401743 6675 raft_consensus.cc:504] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } }
I20260812 02:45:20.403326 6675 leader_election.cc:288] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afa61c1031934a3d948a376413d44ae2 (127.10.75.67:42245), 8dc6f55d632149fb901be88fdbed6447 (127.10.75.66:41775)
Aug 12 02:45:20 dist-test-slave-2p8l krb5kdc[3772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502718, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.66@KRBTEST.COM
Aug 12 02:45:20 dist-test-slave-2p8l krb5kdc[3772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502718, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.67@KRBTEST.COM
I20260812 02:45:20.417672 6678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:20.403194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:42245 (local address 127.10.75.65:40173)
0812 02:45:20.403436 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:20.403453 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:20.403614 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:20.405236 (+ 1622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:20.405241 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:20.405780 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:20.406289 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:20.406306 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:20.407593 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:20.407596 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:20.408475 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:20.408484 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:20.409186 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:20.409190 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:20.409402 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:20.410145 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:20.410169 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:20.412288 (+ 2119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:20.414619 (+ 2331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:20.414625 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:20.414627 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:20.414998 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:20.415434 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:20.415437 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:20.415439 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:20.415675 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:20.416445 (+ 770us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:20.416452 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:20.416844 (+ 392us) client_negotiation.cc:769] Sending connection context
0812 02:45:20.417077 (+ 233us) client_negotiation.cc:240] Negotiation successful
0812 02:45:20.417508 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":299,"spinlock_wait_cycles":33280,"thread_start_us":67,"threads_started":1}
I20260812 02:45:20.417673 6681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:20.403548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:41775 (local address 127.10.75.65:54079)
0812 02:45:20.403878 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:20.403894 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:20.403994 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:20.405491 (+ 1497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:20.405502 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:20.405786 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:20.406291 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:20.406308 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:20.407579 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:20.407582 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:20.408472 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:20.408482 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:20.409204 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:20.409208 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:20.409403 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:20.410152 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:20.410165 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:20.411869 (+ 1704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:20.414504 (+ 2635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:20.414509 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:20.414520 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:20.414998 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:20.415434 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:20.415437 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:20.415439 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:20.415675 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:20.416445 (+ 770us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:20.416452 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:20.416844 (+ 392us) client_negotiation.cc:769] Sending connection context
0812 02:45:20.417077 (+ 233us) client_negotiation.cc:240] Negotiation successful
0812 02:45:20.417454 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"mutex_wait_us":183,"spinlock_wait_cycles":24576,"thread_start_us":74,"threads_started":1}
I20260812 02:45:20.417723 6682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:20.403956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:54079 (local address 127.10.75.66:41775)
0812 02:45:20.404348 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:20.404358 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:20.404388 (+ 30us) server_negotiation.cc:407] Connection header received
0812 02:45:20.405016 (+ 628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:20.405021 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:20.405280 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:20.405548 (+ 268us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:20.406472 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:20.407426 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:20.408613 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:20.409065 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:20.409237 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:20.412128 (+ 2891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:20.412133 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:20.412146 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:20.412173 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:20.414382 (+ 2209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:20.415154 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:20.415159 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:20.415163 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:20.415323 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:20.415785 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:20.415789 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:20.415791 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:20.416308 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:20.416451 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:20.417234 (+ 783us) server_negotiation.cc:299] Negotiation successful
0812 02:45:20.417527 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":150,"threads_started":1}
I20260812 02:45:20.418412 6679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:20.403375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:40173 (local address 127.10.75.67:42245)
0812 02:45:20.403758 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:20.403789 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:20.403835 (+ 46us) server_negotiation.cc:407] Connection header received
0812 02:45:20.404538 (+ 703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:20.404544 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:20.404872 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:20.405190 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:20.406467 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:20.407422 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:20.408612 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:20.409059 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:20.409236 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:20.412484 (+ 3248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:20.412493 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:20.412522 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:20.412556 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:20.414513 (+ 1957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:20.415150 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:20.415157 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:20.415163 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:20.415323 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:20.415785 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:20.415789 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:20.415795 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:20.416308 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:20.416451 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:20.417234 (+ 783us) server_negotiation.cc:299] Negotiation successful
0812 02:45:20.417527 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":67,"threads_started":1}
W20260812 02:45:20.420673 5995 leader_election.cc:341] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8dc6f55d632149fb901be88fdbed6447 (127.10.75.66:41775): Not found: Tablet not found: b79080c6160643c09d0d995d3a422e5f
W20260812 02:45:20.420852 5994 leader_election.cc:341] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer afa61c1031934a3d948a376413d44ae2 (127.10.75.67:42245): Not found: Tablet not found: b79080c6160643c09d0d995d3a422e5f
I20260812 02:45:20.420928 5994 leader_election.cc:302] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd3eeeaec6b8405384ac6f80ba534b2b; no voters: 8dc6f55d632149fb901be88fdbed6447, afa61c1031934a3d948a376413d44ae2
I20260812 02:45:20.421162 6675 raft_consensus.cc:2726] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 02:45:20.591245 6681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:20.590977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:47281)
0812 02:45:20.591101 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:20.591155 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 02:45:20.725759 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:20.725277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:47151)
0812 02:45:20.725577 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:20.725637 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":101,"threads_started":1}
I20260812 02:45:20.928192 6684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:20.927534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:52135)
0812 02:45:20.927954 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:20.928032 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":114,"threads_started":1}
I20260812 02:45:21.593267 6685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:21.592511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:59019)
0812 02:45:21.592955 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:21.593043 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":175,"threads_started":1}
I20260812 02:45:21.727456 6686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:21.726832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:45499)
0812 02:45:21.727235 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:21.727317 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":111,"threads_started":1}
I20260812 02:45:21.930274 6690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:21.929490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:51929)
0812 02:45:21.929886 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:21.929986 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":115,"threads_started":1}
I20260812 02:45:22.514231 6691 raft_consensus.cc:482] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:45:22.514459 6691 raft_consensus.cc:504] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } }
I20260812 02:45:22.515076 6691 leader_election.cc:288] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afa61c1031934a3d948a376413d44ae2 (127.10.75.67:42245), 8dc6f55d632149fb901be88fdbed6447 (127.10.75.66:41775)
W20260812 02:45:22.516273 5994 leader_election.cc:341] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer afa61c1031934a3d948a376413d44ae2 (127.10.75.67:42245): Not found: Tablet not found: b79080c6160643c09d0d995d3a422e5f
W20260812 02:45:22.516439 5995 leader_election.cc:341] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8dc6f55d632149fb901be88fdbed6447 (127.10.75.66:41775): Not found: Tablet not found: b79080c6160643c09d0d995d3a422e5f
I20260812 02:45:22.516516 5995 leader_election.cc:302] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd3eeeaec6b8405384ac6f80ba534b2b; no voters: 8dc6f55d632149fb901be88fdbed6447, afa61c1031934a3d948a376413d44ae2
I20260812 02:45:22.516697 6691 raft_consensus.cc:2726] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 02:45:22.595249 6692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:22.594610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:37409)
0812 02:45:22.594997 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:22.595082 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":112,"threads_started":1}
I20260812 02:45:22.729259 6693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:22.728602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:42997)
0812 02:45:22.729026 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:22.729111 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":113,"threads_started":1}
I20260812 02:45:22.932351 6695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:22.931566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:43671)
0812 02:45:22.932045 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:22.932141 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":158,"threads_started":1}
I20260812 02:45:23.597275 6699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:23.596621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:54957)
0812 02:45:23.597054 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:23.597136 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":113,"threads_started":1}
I20260812 02:45:23.731258 6702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:23.730634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:48605)
0812 02:45:23.731034 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:23.731119 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":113,"threads_started":1}
I20260812 02:45:23.934194 6703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:23.933505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:39303)
0812 02:45:23.933929 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:23.934016 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":107,"threads_started":1}
I20260812 02:45:24.182502 6704 raft_consensus.cc:482] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:45:24.182708 6704 raft_consensus.cc:504] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } }
I20260812 02:45:24.183382 6704 leader_election.cc:288] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afa61c1031934a3d948a376413d44ae2 (127.10.75.67:42245), 8dc6f55d632149fb901be88fdbed6447 (127.10.75.66:41775)
W20260812 02:45:24.184401 5995 leader_election.cc:341] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8dc6f55d632149fb901be88fdbed6447 (127.10.75.66:41775): Not found: Tablet not found: b79080c6160643c09d0d995d3a422e5f
W20260812 02:45:24.184579 5994 leader_election.cc:341] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer afa61c1031934a3d948a376413d44ae2 (127.10.75.67:42245): Not found: Tablet not found: b79080c6160643c09d0d995d3a422e5f
I20260812 02:45:24.184684 5994 leader_election.cc:302] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd3eeeaec6b8405384ac6f80ba534b2b; no voters: 8dc6f55d632149fb901be88fdbed6447, afa61c1031934a3d948a376413d44ae2
I20260812 02:45:24.184921 6704 raft_consensus.cc:2726] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 02:45:24.599295 6708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:24.598635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:59329)
0812 02:45:24.599068 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:24.599153 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":164,"threads_started":1}
I20260812 02:45:24.733201 6709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:24.732534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:48877)
0812 02:45:24.732969 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:24.733057 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":115,"threads_started":1}
I20260812 02:45:24.935541 6710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:24.935089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:57589)
0812 02:45:24.935379 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:24.935438 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":85,"threads_started":1}
I20260812 02:45:25.600714 6711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:25.600224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:38911)
0812 02:45:25.600540 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:25.600608 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":109,"threads_started":1}
I20260812 02:45:25.734655 6713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:25.734173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:34105)
0812 02:45:25.734485 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:25.734542 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":77,"threads_started":1}
I20260812 02:45:25.937454 6715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:25.936743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:59747)
0812 02:45:25.937208 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:25.937295 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":109,"threads_started":1}
I20260812 02:45:26.602662 6716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:26.601972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:52445)
0812 02:45:26.602434 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:26.602520 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":192,"threads_started":1}
I20260812 02:45:26.736585 6719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:26.735976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:38293)
0812 02:45:26.736363 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:26.736449 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":115,"threads_started":1}
I20260812 02:45:26.939549 6720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:26.938861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:55463)
0812 02:45:26.939315 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:26.939402 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":150,"threads_started":1}
I20260812 02:45:27.604691 6725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:27.604023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:38157)
0812 02:45:27.604445 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:27.604547 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":113,"threads_started":1}
I20260812 02:45:27.738492 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:27.737874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:58489)
0812 02:45:27.738276 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:27.738356 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":126,"threads_started":1}
I20260812 02:45:27.941435 6729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:27.940728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:56101)
0812 02:45:27.941212 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:27.941292 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":159,"threads_started":1}
I20260812 02:45:28.180327 6731 raft_consensus.cc:482] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:45:28.180516 6731 raft_consensus.cc:504] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } }
I20260812 02:45:28.181094 6731 leader_election.cc:288] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afa61c1031934a3d948a376413d44ae2 (127.10.75.67:42245), 8dc6f55d632149fb901be88fdbed6447 (127.10.75.66:41775)
W20260812 02:45:28.182212 5995 leader_election.cc:341] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8dc6f55d632149fb901be88fdbed6447 (127.10.75.66:41775): Not found: Tablet not found: b79080c6160643c09d0d995d3a422e5f
W20260812 02:45:28.182370 5994 leader_election.cc:341] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer afa61c1031934a3d948a376413d44ae2 (127.10.75.67:42245): Not found: Tablet not found: b79080c6160643c09d0d995d3a422e5f
I20260812 02:45:28.182435 5995 leader_election.cc:302] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd3eeeaec6b8405384ac6f80ba534b2b; no voters: 8dc6f55d632149fb901be88fdbed6447, afa61c1031934a3d948a376413d44ae2
I20260812 02:45:28.182647 6731 raft_consensus.cc:2726] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 02:45:28.606608 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:28.605937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:40769)
0812 02:45:28.606394 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:28.606470 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":176,"threads_started":1}
I20260812 02:45:28.740013 6733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:28.739476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:60097)
0812 02:45:28.739802 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:28.739868 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":101,"threads_started":1}
I20260812 02:45:28.943203 6734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:28.942641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:34093)
0812 02:45:28.942999 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:28.943068 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":104,"threads_started":1}
I20260812 02:45:29.608330 6735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:29.607696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:59493)
0812 02:45:29.608107 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:29.608191 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":149,"threads_started":1}
I20260812 02:45:29.741739 6737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:29.741104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:36721)
0812 02:45:29.741507 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:29.741599 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":123,"threads_started":1}
I20260812 02:45:29.945712 6738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:29.944477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:57315)
0812 02:45:29.945008 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:29.945114 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":125,"threads_started":1}
I20260812 02:45:30.609740 6739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:30.609264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:44953)
0812 02:45:30.609565 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:30.609631 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":87,"threads_started":1}
I20260812 02:45:30.743347 6740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:30.742835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:52735)
0812 02:45:30.743172 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:30.743237 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":114,"threads_started":1}
I20260812 02:45:30.947255 6741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:30.946769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:40981)
0812 02:45:30.947081 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:30.947144 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":105,"threads_started":1}
I20260812 02:45:31.611322 6742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:31.610750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:42525)
0812 02:45:31.611116 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:31.611186 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":121,"threads_started":1}
I20260812 02:45:31.745070 6745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:31.744539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:41097)
0812 02:45:31.744876 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:31.744940 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":111,"threads_started":1}
I20260812 02:45:31.949123 6746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:31.948447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:39365)
0812 02:45:31.948896 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:31.948985 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":145,"threads_started":1}
I20260812 02:45:32.613034 6747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:32.612406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:50303)
0812 02:45:32.612784 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:32.612864 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":109,"threads_started":1}
I20260812 02:45:32.746805 6750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:32.746185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:33613)
0812 02:45:32.746597 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:32.746666 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":130,"threads_started":1}
I20260812 02:45:32.951323 6751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:32.950484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:59281)
0812 02:45:32.950996 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:32.951145 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":156,"threads_started":1}
I20260812 02:45:33.614629 6752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:33.614173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.65:48859)
0812 02:45:33.614462 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:33.614521 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":81,"threads_started":1}
I20260812 02:45:33.748520 6753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:33.747908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.66:37187)
0812 02:45:33.748314 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:33.748381 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":130,"threads_started":1}
I20260812 02:45:33.903211 6757 raft_consensus.cc:482] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:45:33.903381 6757 raft_consensus.cc:504] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afa61c1031934a3d948a376413d44ae2" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 42245 } } peers { permanent_uuid: "8dc6f55d632149fb901be88fdbed6447" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 41775 } } peers { permanent_uuid: "cd3eeeaec6b8405384ac6f80ba534b2b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42077 } }
I20260812 02:45:33.903887 6757 leader_election.cc:288] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers afa61c1031934a3d948a376413d44ae2 (127.10.75.67:42245), 8dc6f55d632149fb901be88fdbed6447 (127.10.75.66:41775)
W20260812 02:45:33.904790 5994 leader_election.cc:341] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer afa61c1031934a3d948a376413d44ae2 (127.10.75.67:42245): Not found: Tablet not found: b79080c6160643c09d0d995d3a422e5f
W20260812 02:45:33.904881 5995 leader_election.cc:341] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8dc6f55d632149fb901be88fdbed6447 (127.10.75.66:41775): Not found: Tablet not found: b79080c6160643c09d0d995d3a422e5f
I20260812 02:45:33.904942 5995 leader_election.cc:302] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd3eeeaec6b8405384ac6f80ba534b2b; no voters: 8dc6f55d632149fb901be88fdbed6447, afa61c1031934a3d948a376413d44ae2
I20260812 02:45:33.905097 6757 raft_consensus.cc:2726] T b79080c6160643c09d0d995d3a422e5f P cd3eeeaec6b8405384ac6f80ba534b2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 02:45:33.922106 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 5900
I20260812 02:45:33.936208 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 6203
I20260812 02:45:33.952955 6762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:33.952472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:37925 (local address 127.10.75.67:32851)
0812 02:45:33.952783 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:33.952842 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":95,"threads_started":1}
I20260812 02:45:33.953831 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 6437
2026-08-12T02:45:33Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19728 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:45:34 dist-test-slave-2p8l krb5kdc[6765](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:45:34 dist-test-slave-2p8l krb5kdc[6765](info): set up 2 sockets
Aug 12 02:45:34 dist-test-slave-2p8l krb5kdc[6765](info): commencing operation
krb5kdc: starting...
W20260812 02:45:35.259003 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:45:35 dist-test-slave-2p8l krb5kdc[6765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:45:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:45:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:45:35.393402 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:35201
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:35201
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:45:35.502661 6788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:35.502947 6788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:35.503017 6788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:35.507005 6788 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 02:45:35.507082 6788 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 02:45:35.507112 6788 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 02:45:35.507146 6788 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:45:35.507182 6788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:35.507241 6788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:35.507282 6788 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:45:35.507318 6788 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:45:35.512399 6788 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:35201
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:35201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:35.513430 6788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:35.514482 6788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:35.523516 6798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:35.523552 6795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:35.523610 6788 server_base.cc:1034] running on GCE node
W20260812 02:45:35.523547 6794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:35.524480 6788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:35.525621 6788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:35.526813 6788 hybrid_clock.cc:648] HybridClock initialized: now 1786502735526787 us; error 43 us; skew 500 ppm
Aug 12 02:45:35 dist-test-slave-2p8l krb5kdc[6765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502735, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:35.544584 6788 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:45:35.545578 6788 webserver.cc:460] Webserver started at http://127.10.75.126:41899/ using document root <none> and password file <none>
I20260812 02:45:35.546272 6788 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:35.546375 6788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:35.546645 6788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:45:35.548863 6788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "1c023ecc382a43da8d20e9e068f83c28"
format_stamp: "Formatted at 2026-08-12 02:45:35 on dist-test-slave-2p8l"
server_key: "25f71c9c15d2b3a2afe4aab9eb193d7c"
server_key_iv: "32f6045b8f842421c1e89e473f9c8a99"
server_key_version: "encryptionkey@0"
I20260812 02:45:35.549463 6788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "1c023ecc382a43da8d20e9e068f83c28"
format_stamp: "Formatted at 2026-08-12 02:45:35 on dist-test-slave-2p8l"
server_key: "25f71c9c15d2b3a2afe4aab9eb193d7c"
server_key_iv: "32f6045b8f842421c1e89e473f9c8a99"
server_key_version: "encryptionkey@0"
I20260812 02:45:35.553509 6788 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260812 02:45:35.556295 6809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:35.557531 6788 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:45:35.557710 6788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "1c023ecc382a43da8d20e9e068f83c28"
format_stamp: "Formatted at 2026-08-12 02:45:35 on dist-test-slave-2p8l"
server_key: "25f71c9c15d2b3a2afe4aab9eb193d7c"
server_key_iv: "32f6045b8f842421c1e89e473f9c8a99"
server_key_version: "encryptionkey@0"
I20260812 02:45:35.557837 6788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:35.576354 6788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:35.579803 6788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:35.580015 6788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:35.587875 6788 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:35201
I20260812 02:45:35.588194 6905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:35201 every 8 connection(s)
I20260812 02:45:35.588936 6788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:45:35.589973 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 6788
I20260812 02:45:35.590154 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:45:35.590473 10541 external_mini_cluster.cc:1428] Setting key 0fdd36b63ff8998885ce8093c1331756
I20260812 02:45:35.592144 6906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:35.598558 6906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28: Bootstrap starting.
Aug 12 02:45:35 dist-test-slave-2p8l krb5kdc[6765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:35.601336 6906 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:35.602126 6906 log.cc:824] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:35.604579 6906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28: No bootstrap required, opened a new log
I20260812 02:45:35.605930 6909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:35.591949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43258 (local address 127.10.75.126:35201)
0812 02:45:35.592415 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:35.592432 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:35.592473 (+ 41us) server_negotiation.cc:407] Connection header received
0812 02:45:35.593174 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:35.593190 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:35.593510 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:35.593809 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:35.594748 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:35.595823 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:35.596981 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:35.597491 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:35.597626 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:35.600727 (+ 3101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:35.600735 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:35.600755 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:35.600790 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:35.602988 (+ 2198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:35.603566 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:35.603571 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:35.603575 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:35.603684 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:35.604008 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:35.604011 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:35.604012 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:35.604398 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:35.604594 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:35.604921 (+ 327us) server_negotiation.cc:299] Negotiation successful
0812 02:45:35.605231 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":169,"threads_started":1}
I20260812 02:45:35.608873 6906 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c023ecc382a43da8d20e9e068f83c28" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35201 } }
I20260812 02:45:35.609145 6906 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:35.609236 6906 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c023ecc382a43da8d20e9e068f83c28, State: Initialized, Role: FOLLOWER
I20260812 02:45:35.609724 6906 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c023ecc382a43da8d20e9e068f83c28" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35201 } }
I20260812 02:45:35.609886 6906 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:45:35.609983 6906 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:45:35.610121 6906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:35.611066 6906 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c023ecc382a43da8d20e9e068f83c28" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35201 } }
I20260812 02:45:35.611418 6906 leader_election.cc:302] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c023ecc382a43da8d20e9e068f83c28; no voters:
I20260812 02:45:35.611779 6906 leader_election.cc:288] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:45:35.611860 6912 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:45:35.612171 6912 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 1 LEADER]: Becoming Leader. State: Replica: 1c023ecc382a43da8d20e9e068f83c28, State: Running, Role: LEADER
I20260812 02:45:35.612563 6912 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c023ecc382a43da8d20e9e068f83c28" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35201 } }
I20260812 02:45:35.613082 6906 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:45:35.614224 6913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c023ecc382a43da8d20e9e068f83c28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c023ecc382a43da8d20e9e068f83c28" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35201 } } }
I20260812 02:45:35.614357 6913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [sys.catalog]: This master's current role is: LEADER
I20260812 02:45:35.614636 6914 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c023ecc382a43da8d20e9e068f83c28. Latest consensus state: current_term: 1 leader_uuid: "1c023ecc382a43da8d20e9e068f83c28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c023ecc382a43da8d20e9e068f83c28" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35201 } } }
I20260812 02:45:35.614789 6914 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [sys.catalog]: This master's current role is: LEADER
I20260812 02:45:35.614794 6923 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:45:35.618038 6923 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:45:35.623426 6923 catalog_manager.cc:1347] Generated new cluster ID: 6357d292b49e4ebd938b087b9d472d58
I20260812 02:45:35.623493 6923 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:45:35.646471 6923 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:45:35.647703 6923 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:45:35.655988 6923 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28: Generated new TSK 0
I20260812 02:45:35.656737 6923 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
I20260812 02:45:35.689260 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35201
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:45:35.801285 6951 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:35.801529 6951 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:35.801573 6951 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:35.805610 6951 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:35.805668 6951 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:35.805725 6951 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:45:35.810818 6951 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6951
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:35.811895 6951 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:35.812960 6951 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:35.822481 6967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:35.822533 6966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:35.822517 6971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:35.823246 6951 server_base.cc:1034] running on GCE node
I20260812 02:45:35.823596 6951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:35.824173 6951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:35.825337 6951 hybrid_clock.cc:648] HybridClock initialized: now 1786502735825298 us; error 52 us; skew 500 ppm
Aug 12 02:45:35 dist-test-slave-2p8l krb5kdc[6765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502735, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:35.828104 6951 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:45:35.828927 6951 webserver.cc:460] Webserver started at http://127.10.75.65:43149/ using document root <none> and password file <none>
I20260812 02:45:35.829478 6951 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:35.829538 6951 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:35.829767 6951 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:45:35.831852 6951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "c7e97718bd554fbf8fbc0df910f78b95"
format_stamp: "Formatted at 2026-08-12 02:45:35 on dist-test-slave-2p8l"
server_key: "024123a5121087d39d283738e0bce080"
server_key_iv: "2f6d5ac0a688c4f21dd7ef1007a196b8"
server_key_version: "encryptionkey@0"
I20260812 02:45:35.832405 6951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "c7e97718bd554fbf8fbc0df910f78b95"
format_stamp: "Formatted at 2026-08-12 02:45:35 on dist-test-slave-2p8l"
server_key: "024123a5121087d39d283738e0bce080"
server_key_iv: "2f6d5ac0a688c4f21dd7ef1007a196b8"
server_key_version: "encryptionkey@0"
I20260812 02:45:35.836055 6951 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 02:45:35.838331 6988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:35.839566 6951 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 02:45:35.839695 6951 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "c7e97718bd554fbf8fbc0df910f78b95"
format_stamp: "Formatted at 2026-08-12 02:45:35 on dist-test-slave-2p8l"
server_key: "024123a5121087d39d283738e0bce080"
server_key_iv: "2f6d5ac0a688c4f21dd7ef1007a196b8"
server_key_version: "encryptionkey@0"
I20260812 02:45:35.839798 6951 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:35.856427 6951 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:35.859617 6951 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:35.859835 6951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:35.860446 6951 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:35.861423 6951 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:45:35.861492 6951 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:35.861553 6951 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:45:35.861605 6951 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:35.870592 6951 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:42303
I20260812 02:45:35.870664 7178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:42303 every 8 connection(s)
I20260812 02:45:35.871474 6951 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:45:35.875619 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 6951
I20260812 02:45:35.875773 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:45:35.876060 10541 external_mini_cluster.cc:1428] Setting key 286b098f383aadf9b7021d12ca96caaa
Aug 12 02:45:35 dist-test-slave-2p8l krb5kdc[6765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502735, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:35.885668 6909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:35.873318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:40623 (local address 127.10.75.126:35201)
0812 02:45:35.873483 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:35.873488 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:35.874420 (+ 932us) server_negotiation.cc:407] Connection header received
0812 02:45:35.875838 (+ 1418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:35.875842 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:35.875904 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:35.876010 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:35.877176 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:35.877718 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:35.878902 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:35.879141 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:35.879246 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:35.882024 (+ 2778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:35.882049 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:35.882051 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:35.882116 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:35.883608 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:35.884113 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:35.884116 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:35.884118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:35.884199 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:35.884616 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:35.884623 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:35.884624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:35.884802 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:35.884910 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:35.885372 (+ 462us) server_negotiation.cc:299] Negotiation successful
0812 02:45:35.885498 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 02:45:35.886466 7182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:35.873751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:40623)
0812 02:45:35.874267 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:35.874310 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:35.875605 (+ 1295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:35.876211 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:35.876220 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:35.876580 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:35.877027 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:35.877042 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:35.877846 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:35.877849 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:35.878775 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:35.878784 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:35.879296 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:35.879301 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:35.879542 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:35.880182 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:35.880208 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:35.881857 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:35.883727 (+ 1870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:35.883733 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:35.883746 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:35.883996 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:35.884316 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:35.884319 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:35.884321 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:35.884460 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:35.884909 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:35.884916 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:35.885145 (+ 229us) client_negotiation.cc:769] Sending connection context
0812 02:45:35.885325 (+ 180us) client_negotiation.cc:240] Negotiation successful
0812 02:45:35.885636 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":120,"threads_started":1}
WARNING: no policy specified for kudu/127.10.75.66@KRBTEST.COM; defaulting to no policy
I20260812 02:45:35.887850 7180 heartbeater.cc:347] Connected to a master server at 127.10.75.126:35201
I20260812 02:45:35.888113 7180 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:35.888660 7180 heartbeater.cc:511] Master 127.10.75.126:35201 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.66@KRBTEST.COM" created.
I20260812 02:45:35.890262 6841 ts_manager.cc:194] Registered new tserver with Master: c7e97718bd554fbf8fbc0df910f78b95 (127.10.75.65:42303)
I20260812 02:45:35.891927 6841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:40623
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
I20260812 02:45:35.908896 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35201
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:45:36.023456 7189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:36.023728 7189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:36.023772 7189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:36.027927 7189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:36.027997 7189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:36.028085 7189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:45:36.033367 7189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:36.034435 7189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:36.035454 7189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:36.045610 7199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:36.045605 7197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:36.045614 7201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:36.046013 7189 server_base.cc:1034] running on GCE node
I20260812 02:45:36.046432 7189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:36.047173 7189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:36.048342 7189 hybrid_clock.cc:648] HybridClock initialized: now 1786502736048329 us; error 31 us; skew 500 ppm
Aug 12 02:45:36 dist-test-slave-2p8l krb5kdc[6765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502736, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:36.051357 7189 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:45:36.052218 7189 webserver.cc:460] Webserver started at http://127.10.75.66:33095/ using document root <none> and password file <none>
I20260812 02:45:36.052778 7189 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:36.052870 7189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:36.053102 7189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:45:36.055151 7189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "2dfb264b589d495b9fcd6d5f6c7b907e"
format_stamp: "Formatted at 2026-08-12 02:45:36 on dist-test-slave-2p8l"
server_key: "5a1f07b709c8c1169cbb6c2e6533ecc0"
server_key_iv: "b18949ca10c150c2e9e854bdfe9d4bd3"
server_key_version: "encryptionkey@0"
I20260812 02:45:36.055732 7189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "2dfb264b589d495b9fcd6d5f6c7b907e"
format_stamp: "Formatted at 2026-08-12 02:45:36 on dist-test-slave-2p8l"
server_key: "5a1f07b709c8c1169cbb6c2e6533ecc0"
server_key_iv: "b18949ca10c150c2e9e854bdfe9d4bd3"
server_key_version: "encryptionkey@0"
I20260812 02:45:36.059337 7189 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 02:45:36.061769 7210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:36.063063 7189 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:45:36.063211 7189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "2dfb264b589d495b9fcd6d5f6c7b907e"
format_stamp: "Formatted at 2026-08-12 02:45:36 on dist-test-slave-2p8l"
server_key: "5a1f07b709c8c1169cbb6c2e6533ecc0"
server_key_iv: "b18949ca10c150c2e9e854bdfe9d4bd3"
server_key_version: "encryptionkey@0"
I20260812 02:45:36.063328 7189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:36.073879 7189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:36.076818 7189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:36.077020 7189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:36.077598 7189 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:36.078483 7189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:45:36.078555 7189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:36.078670 7189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:45:36.078709 7189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:36.087877 7189 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:45321
I20260812 02:45:36.087911 7427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:45321 every 8 connection(s)
I20260812 02:45:36.088761 7189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:45:36.096275 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 7189
I20260812 02:45:36.096446 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:45:36.096838 10541 external_mini_cluster.cc:1428] Setting key 70352d9d23e2eb3cb69146044f19c6ea
Aug 12 02:45:36 dist-test-slave-2p8l krb5kdc[6765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502736, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:36.102985 6909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.090631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:37147 (local address 127.10.75.126:35201)
0812 02:45:36.090776 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:36.090780 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:36.091616 (+ 836us) server_negotiation.cc:407] Connection header received
0812 02:45:36.092952 (+ 1336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:36.092955 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:36.093018 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:36.093098 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:36.094238 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.094777 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.095892 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.096145 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.096253 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.099149 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:36.099153 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:36.099155 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:36.099182 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:36.100815 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:36.101350 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:36.101353 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:36.101355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:36.101440 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:36.101796 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:36.101801 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:36.101802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:36.101980 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:36.102139 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:36.102693 (+ 554us) server_negotiation.cc:299] Negotiation successful
0812 02:45:36.102817 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 02:45:36.103834 7430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.091013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:37147)
0812 02:45:36.091466 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:36.091507 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:36.092745 (+ 1238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:36.093270 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:36.093277 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:36.093610 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:36.094047 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:36.094095 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.094912 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.094920 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:36.095765 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:36.095774 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.096302 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.096306 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:36.096532 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.097226 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:36.097285 (+ 59us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:36.098982 (+ 1697us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:36.100951 (+ 1969us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:36.100957 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:36.100971 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:36.101234 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:36.101544 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:36.101547 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:36.101549 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:36.101683 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:36.102138 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:36.102145 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:36.102365 (+ 220us) client_negotiation.cc:769] Sending connection context
0812 02:45:36.102646 (+ 281us) client_negotiation.cc:240] Negotiation successful
0812 02:45:36.102954 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":129,"threads_started":1}
I20260812 02:45:36.104998 7428 heartbeater.cc:347] Connected to a master server at 127.10.75.126:35201
I20260812 02:45:36.105278 7428 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:36.105947 7428 heartbeater.cc:511] Master 127.10.75.126:35201 requested a full tablet report, sending...
I20260812 02:45:36.107169 6841 ts_manager.cc:194] Registered new tserver with Master: 2dfb264b589d495b9fcd6d5f6c7b907e (127.10.75.66:45321)
I20260812 02:45:36.107743 6841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:37147
WARNING: no policy specified for kudu/127.10.75.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
I20260812 02:45:36.129988 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35201
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:45:36.248001 7433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:36.248236 7433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:36.248279 7433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:36.252346 7433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:36.252436 7433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:36.252516 7433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:45:36.257771 7433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:35201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:36.258735 7433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:36.259660 7433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:36.269479 7452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:36.269476 7443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:36.269472 7456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:36.269862 7433 server_base.cc:1034] running on GCE node
I20260812 02:45:36.270331 7433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:36.270982 7433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:36.272205 7433 hybrid_clock.cc:648] HybridClock initialized: now 1786502736272177 us; error 52 us; skew 500 ppm
Aug 12 02:45:36 dist-test-slave-2p8l krb5kdc[6765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502736, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:36.275147 7433 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:45:36.276057 7433 webserver.cc:460] Webserver started at http://127.10.75.67:42361/ using document root <none> and password file <none>
I20260812 02:45:36.276628 7433 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:36.276721 7433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:36.276947 7433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:45:36.279004 7433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a"
format_stamp: "Formatted at 2026-08-12 02:45:36 on dist-test-slave-2p8l"
server_key: "82c33fe683287bf169b9a7d0e15ee230"
server_key_iv: "0affd5d825688ea8e841766b7962d427"
server_key_version: "encryptionkey@0"
I20260812 02:45:36.279582 7433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a"
format_stamp: "Formatted at 2026-08-12 02:45:36 on dist-test-slave-2p8l"
server_key: "82c33fe683287bf169b9a7d0e15ee230"
server_key_iv: "0affd5d825688ea8e841766b7962d427"
server_key_version: "encryptionkey@0"
I20260812 02:45:36.283226 7433 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260812 02:45:36.285678 7467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:36.287082 7433 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:45:36.287237 7433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a"
format_stamp: "Formatted at 2026-08-12 02:45:36 on dist-test-slave-2p8l"
server_key: "82c33fe683287bf169b9a7d0e15ee230"
server_key_iv: "0affd5d825688ea8e841766b7962d427"
server_key_version: "encryptionkey@0"
I20260812 02:45:36.287359 7433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:36.308586 7433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:36.312193 7433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:36.312433 7433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:36.313143 7433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:36.314196 7433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:45:36.314276 7433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:36.314357 7433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:45:36.314415 7433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:36.324218 7433 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:34315
I20260812 02:45:36.324239 7683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:34315 every 8 connection(s)
I20260812 02:45:36.325129 7433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:45:36.326982 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 7433
I20260812 02:45:36.327121 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:45:36.327415 10541 external_mini_cluster.cc:1428] Setting key a8e915cca90251db43938dfacb74c81a
Aug 12 02:45:36 dist-test-slave-2p8l krb5kdc[6765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502736, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:36.339383 6909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.327114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:56099 (local address 127.10.75.126:35201)
0812 02:45:36.327265 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:36.327270 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:36.328241 (+ 971us) server_negotiation.cc:407] Connection header received
0812 02:45:36.329989 (+ 1748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:36.329992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:36.330082 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:36.330157 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:36.331295 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.331827 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.332956 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.333183 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.333289 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.335799 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:36.335803 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:36.335806 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:36.335839 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:36.337212 (+ 1373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:36.337799 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:36.337802 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:36.337804 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:36.337888 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:36.338320 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:36.338323 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:36.338324 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:36.338506 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:36.338618 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:36.339097 (+ 479us) server_negotiation.cc:299] Negotiation successful
0812 02:45:36.339215 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 02:45:36.340278 7686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.327579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:56099)
0812 02:45:36.328072 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:36.328113 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:36.329750 (+ 1637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:36.330328 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:36.330335 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:36.330704 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:36.331148 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:36.331160 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.331953 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.331957 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:36.332819 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:36.332829 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.333341 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.333345 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:36.333513 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.334099 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:36.334125 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:36.335637 (+ 1512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:36.337347 (+ 1710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:36.337353 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:36.337367 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:36.337679 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:36.337992 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:36.337995 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:36.337997 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:36.338203 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:36.338617 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:36.338624 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:36.338854 (+ 230us) client_negotiation.cc:769] Sending connection context
0812 02:45:36.339051 (+ 197us) client_negotiation.cc:240] Negotiation successful
0812 02:45:36.339350 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":134,"threads_started":1}
I20260812 02:45:36.341531 7684 heartbeater.cc:347] Connected to a master server at 127.10.75.126:35201
I20260812 02:45:36.341775 7684 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:36.342274 7684 heartbeater.cc:511] Master 127.10.75.126:35201 requested a full tablet report, sending...
I20260812 02:45:36.343360 6841 ts_manager.cc:194] Registered new tserver with Master: 3ab6f7bc8ee640f4b0fe5b635b61bd7a (127.10.75.67:34315)
I20260812 02:45:36.343874 6841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:56099
I20260812 02:45:36.353453 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:45:36.363144 6909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.355665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46320 (local address 127.10.75.126:35201)
0812 02:45:36.355778 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:36.355781 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:36.355960 (+ 179us) server_negotiation.cc:407] Connection header received
0812 02:45:36.356065 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:36.356068 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:36.356104 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:36.356169 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:36.356904 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.357463 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.358343 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.358607 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.358698 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.360045 (+ 1347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:36.360048 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:36.360050 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:36.360074 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:36.361438 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:36.361916 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:36.361920 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:36.361921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:36.362053 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:36.362331 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:36.362333 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:36.362334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:36.362570 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:36.362681 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:36.362922 (+ 241us) server_negotiation.cc:299] Negotiation successful
0812 02:45:36.363027 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 02:45:36.365963 6841 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46320:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:45:36.368973 6841 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:45:36.383464 7704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.377852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33004 (local address 127.10.75.66:45321)
0812 02:45:36.378621 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:36.378635 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:36.378665 (+ 30us) server_negotiation.cc:407] Connection header received
0812 02:45:36.378753 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:36.378759 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:36.378972 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:36.379570 (+ 598us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:36.379750 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.380675 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.382217 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.382815 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.382927 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.383068 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:36.383218 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 02:45:36.383314 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":113,"threads_started":1}
I20260812 02:45:36.383467 7703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.377655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:45321 (local address 127.0.0.1:33004)
0812 02:45:36.378011 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:36.378087 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:36.378225 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:36.379172 (+ 947us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:36.379189 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:36.379214 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:36.379378 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:36.379387 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.380804 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.380810 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:36.382027 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:36.382037 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.382918 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.382921 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:36.383007 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.383036 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 02:45:36.383179 (+ 143us) client_negotiation.cc:240] Negotiation successful
0812 02:45:36.383302 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":2,"thread_start_us":112,"threads_started":1}
I20260812 02:45:36.384328 7710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.378137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:34315 (local address 127.0.0.1:46092)
0812 02:45:36.379181 (+ 1044us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:36.379201 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:36.379336 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:36.379807 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:36.379810 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:36.379828 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:36.379935 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:36.379945 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.381363 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.381367 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:36.382662 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:36.382675 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.383902 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.383905 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:36.383994 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.384026 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 02:45:36.384097 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 02:45:36.384193 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":981,"spinlock_wait_cycles":2176,"thread_start_us":112,"threads_started":1}
I20260812 02:45:36.384938 7712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.378594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46092 (local address 127.10.75.67:34315)
0812 02:45:36.379040 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:36.379056 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:36.379297 (+ 241us) server_negotiation.cc:407] Connection header received
0812 02:45:36.379480 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:36.379484 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:36.379674 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:36.379828 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:36.380055 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.381202 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.382808 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.383597 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.383703 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.383833 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:36.384695 (+ 862us) server_negotiation.cc:299] Negotiation successful
0812 02:45:36.384793 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":137,"threads_started":1}
I20260812 02:45:36.385134 7714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.378856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33796 (local address 127.10.75.65:42303)
0812 02:45:36.379120 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:36.379135 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:36.379439 (+ 304us) server_negotiation.cc:407] Connection header received
0812 02:45:36.379524 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:36.379529 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:36.379704 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:36.379850 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:36.380269 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.381374 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.383146 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.383985 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.384100 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.384825 (+ 725us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:36.384876 (+ 51us) server_negotiation.cc:299] Negotiation successful
0812 02:45:36.384970 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":80,"threads_started":1}
I20260812 02:45:36.384480 7709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.378452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:42303 (local address 127.0.0.1:33796)
0812 02:45:36.379226 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:36.379240 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:36.379339 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:36.380008 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:36.380011 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:36.380029 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:36.380140 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:36.380146 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.381517 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.381520 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:36.382678 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:36.382685 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.384098 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.384102 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:36.384200 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.384224 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 02:45:36.384288 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 02:45:36.384354 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":710,"mutex_wait_us":28,"spinlock_wait_cycles":5248,"thread_start_us":91,"threads_started":1}
I20260812 02:45:36.386947 7300 tablet_service.cc:1467] Processing CreateTablet for tablet ba4daf01ccde4ab1a6dd92480ebeea07 (DEFAULT_TABLE table=test-table [id=4b85c6ddd02d4c539dbda39cb8cea7ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:45:36.387567 7062 tablet_service.cc:1467] Processing CreateTablet for tablet ba4daf01ccde4ab1a6dd92480ebeea07 (DEFAULT_TABLE table=test-table [id=4b85c6ddd02d4c539dbda39cb8cea7ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:45:36.388137 7300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba4daf01ccde4ab1a6dd92480ebeea07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:36.387867 7550 tablet_service.cc:1467] Processing CreateTablet for tablet ba4daf01ccde4ab1a6dd92480ebeea07 (DEFAULT_TABLE table=test-table [id=4b85c6ddd02d4c539dbda39cb8cea7ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:45:36.388500 7062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba4daf01ccde4ab1a6dd92480ebeea07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:36.388837 7550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba4daf01ccde4ab1a6dd92480ebeea07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:36.394721 7716 tablet_bootstrap.cc:492] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95: Bootstrap starting.
I20260812 02:45:36.396142 7718 tablet_bootstrap.cc:492] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e: Bootstrap starting.
I20260812 02:45:36.396934 7716 tablet_bootstrap.cc:654] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:36.397356 7717 tablet_bootstrap.cc:492] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Bootstrap starting.
I20260812 02:45:36.397850 7716 log.cc:824] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:36.398427 7718 tablet_bootstrap.cc:654] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:36.399290 7718 log.cc:824] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:36.399442 7717 tablet_bootstrap.cc:654] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:36.400151 7716 tablet_bootstrap.cc:492] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95: No bootstrap required, opened a new log
I20260812 02:45:36.400357 7716 ts_tablet_manager.cc:1397] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 02:45:36.400709 7717 log.cc:824] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:36.401280 7718 tablet_bootstrap.cc:492] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e: No bootstrap required, opened a new log
I20260812 02:45:36.401477 7718 ts_tablet_manager.cc:1397] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 02:45:36.402770 7717 tablet_bootstrap.cc:492] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: No bootstrap required, opened a new log
I20260812 02:45:36.402972 7717 ts_tablet_manager.cc:1397] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260812 02:45:36.404464 7718 raft_consensus.cc:348] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } }
I20260812 02:45:36.404868 7718 raft_consensus.cc:374] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:36.404798 7716 raft_consensus.cc:348] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } }
I20260812 02:45:36.404991 7718 raft_consensus.cc:729] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dfb264b589d495b9fcd6d5f6c7b907e, State: Initialized, Role: FOLLOWER
I20260812 02:45:36.405082 7716 raft_consensus.cc:374] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:36.405182 7716 raft_consensus.cc:729] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7e97718bd554fbf8fbc0df910f78b95, State: Initialized, Role: FOLLOWER
I20260812 02:45:36.405623 7718 consensus_queue.cc:260] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } }
I20260812 02:45:36.405637 7716 consensus_queue.cc:260] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } }
I20260812 02:45:36.406333 7180 heartbeater.cc:503] Master 127.10.75.126:35201 was elected leader, sending a full tablet report...
I20260812 02:45:36.406653 7718 ts_tablet_manager.cc:1428] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 02:45:36.406737 7717 raft_consensus.cc:348] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } }
I20260812 02:45:36.406972 7717 raft_consensus.cc:374] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:36.407019 7717 raft_consensus.cc:729] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ab6f7bc8ee640f4b0fe5b635b61bd7a, State: Initialized, Role: FOLLOWER
I20260812 02:45:36.407394 7428 heartbeater.cc:503] Master 127.10.75.126:35201 was elected leader, sending a full tablet report...
I20260812 02:45:36.407390 7717 consensus_queue.cc:260] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } }
I20260812 02:45:36.408079 7684 heartbeater.cc:503] Master 127.10.75.126:35201 was elected leader, sending a full tablet report...
I20260812 02:45:36.408365 7717 ts_tablet_manager.cc:1428] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 02:45:36.408733 7716 ts_tablet_manager.cc:1428] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
W20260812 02:45:36.576222 7685 tablet.cc:2369] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 02:45:36.589929 7429 tablet.cc:2369] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 02:45:36.623117 7181 tablet.cc:2369] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:45:36.657272 7730 raft_consensus.cc:482] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:45:36.657470 7730 raft_consensus.cc:504] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } }
I20260812 02:45:36.658672 7730 leader_election.cc:288] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dfb264b589d495b9fcd6d5f6c7b907e (127.10.75.66:45321), c7e97718bd554fbf8fbc0df910f78b95 (127.10.75.65:42303)
I20260812 02:45:36.662781 7704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.659100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:45803 (local address 127.10.75.66:45321)
0812 02:45:36.659247 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:36.659268 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:36.659289 (+ 21us) server_negotiation.cc:407] Connection header received
0812 02:45:36.659387 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:36.659392 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:36.659449 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:36.659562 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:36.659886 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.660406 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.661620 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.662174 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.662318 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.662391 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:36.662600 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 02:45:36.662673 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 02:45:36.662781 7686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.658987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:45321 (local address 127.10.75.67:45803)
0812 02:45:36.659137 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:36.659156 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:36.659272 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:36.659578 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:36.659582 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:36.659604 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:36.659753 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:36.659759 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.660528 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.660533 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:36.661480 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:36.661508 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.662329 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.662332 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:36.662443 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.662467 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 02:45:36.662564 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 02:45:36.662644 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 02:45:36.663317 7729 raft_consensus.cc:482] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:45:36.663504 7732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.659346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:42303 (local address 127.10.75.67:43631)
0812 02:45:36.659752 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:36.659763 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:36.659892 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:36.660194 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:36.660197 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:36.660217 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:36.660346 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:36.660352 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.661169 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.661173 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:36.662133 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:36.662148 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.663073 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.663077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:36.663182 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.663211 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 02:45:36.663295 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 02:45:36.663364 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":142,"threads_started":1}
I20260812 02:45:36.663587 7714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.659505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:43631 (local address 127.10.75.65:42303)
0812 02:45:36.659656 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:36.659662 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:36.659850 (+ 188us) server_negotiation.cc:407] Connection header received
0812 02:45:36.660028 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:36.660031 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:36.660078 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:36.660166 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:36.660468 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.661034 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.662287 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.662902 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.663062 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.663109 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:36.663344 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 02:45:36.663435 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 02:45:36.663513 7729 raft_consensus.cc:504] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } }
I20260812 02:45:36.663672 7340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba4daf01ccde4ab1a6dd92480ebeea07" candidate_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" is_pre_election: true
I20260812 02:45:36.663944 7340 raft_consensus.cc:2454] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ab6f7bc8ee640f4b0fe5b635b61bd7a in term 0.
I20260812 02:45:36.664441 7470 leader_election.cc:302] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dfb264b589d495b9fcd6d5f6c7b907e, 3ab6f7bc8ee640f4b0fe5b635b61bd7a; no voters:
I20260812 02:45:36.664649 7729 leader_election.cc:288] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7e97718bd554fbf8fbc0df910f78b95 (127.10.75.65:42303), 3ab6f7bc8ee640f4b0fe5b635b61bd7a (127.10.75.67:34315)
I20260812 02:45:36.664804 7730 raft_consensus.cc:2781] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:45:36.664770 7096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba4daf01ccde4ab1a6dd92480ebeea07" candidate_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7e97718bd554fbf8fbc0df910f78b95" is_pre_election: true
I20260812 02:45:36.664891 7730 raft_consensus.cc:482] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:45:36.664947 7730 raft_consensus.cc:3037] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:36.665066 7096 raft_consensus.cc:2454] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ab6f7bc8ee640f4b0fe5b635b61bd7a in term 0.
I20260812 02:45:36.666469 7730 raft_consensus.cc:504] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } }
I20260812 02:45:36.666821 7730 leader_election.cc:288] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [CANDIDATE]: Term 1 election: Requested vote from peers 2dfb264b589d495b9fcd6d5f6c7b907e (127.10.75.66:45321), c7e97718bd554fbf8fbc0df910f78b95 (127.10.75.65:42303)
I20260812 02:45:36.667251 7340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba4daf01ccde4ab1a6dd92480ebeea07" candidate_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e"
I20260812 02:45:36.667346 7096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba4daf01ccde4ab1a6dd92480ebeea07" candidate_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7e97718bd554fbf8fbc0df910f78b95"
I20260812 02:45:36.667378 7340 raft_consensus.cc:3037] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:36.667464 7096 raft_consensus.cc:3037] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:36.668763 7096 raft_consensus.cc:2454] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ab6f7bc8ee640f4b0fe5b635b61bd7a in term 1.
I20260812 02:45:36.668766 7340 raft_consensus.cc:2454] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ab6f7bc8ee640f4b0fe5b635b61bd7a in term 1.
I20260812 02:45:36.669109 7470 leader_election.cc:302] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dfb264b589d495b9fcd6d5f6c7b907e, 3ab6f7bc8ee640f4b0fe5b635b61bd7a; no voters:
I20260812 02:45:36.669405 7730 raft_consensus.cc:2781] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:45:36.669653 7730 raft_consensus.cc:686] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 1 LEADER]: Becoming Leader. State: Replica: 3ab6f7bc8ee640f4b0fe5b635b61bd7a, State: Running, Role: LEADER
I20260812 02:45:36.670047 7733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.664811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:42303 (local address 127.10.75.66:37623)
0812 02:45:36.665445 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:36.665462 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:36.665650 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:36.666225 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:36.666228 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:36.666248 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:36.666383 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:36.666393 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.667319 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.667322 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:36.668618 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:36.668632 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.669605 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.669612 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:36.669723 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.669747 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 02:45:36.669820 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 02:45:36.669888 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":89,"threads_started":1}
I20260812 02:45:36.669996 7730 consensus_queue.cc:237] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } }
I20260812 02:45:36.670104 7714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.665171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:37623 (local address 127.10.75.65:42303)
0812 02:45:36.665286 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:36.665292 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:36.665557 (+ 265us) server_negotiation.cc:407] Connection header received
0812 02:45:36.665793 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:36.665796 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:36.665841 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:36.665915 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:36.666510 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.667187 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.668773 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.669369 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.669484 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.669534 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:36.669848 (+ 314us) server_negotiation.cc:299] Negotiation successful
0812 02:45:36.669947 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 02:45:36.670863 7096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba4daf01ccde4ab1a6dd92480ebeea07" candidate_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7e97718bd554fbf8fbc0df910f78b95" is_pre_election: true
I20260812 02:45:36.671079 7096 raft_consensus.cc:2379] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2dfb264b589d495b9fcd6d5f6c7b907e in current term 1: Already voted for candidate 3ab6f7bc8ee640f4b0fe5b635b61bd7a in this term.
I20260812 02:45:36.671350 7712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.665343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:46103 (local address 127.10.75.67:34315)
0812 02:45:36.665448 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:36.665454 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:36.665989 (+ 535us) server_negotiation.cc:407] Connection header received
0812 02:45:36.666156 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:36.666163 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:36.666217 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:36.666312 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:36.666767 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.667562 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.669175 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.669859 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.669978 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.670046 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:36.671166 (+ 1120us) server_negotiation.cc:299] Negotiation successful
0812 02:45:36.671242 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 02:45:36.672005 7735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.664964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:34315 (local address 127.10.75.66:46103)
0812 02:45:36.665898 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:36.665914 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:36.666016 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:36.666416 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:36.666422 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:36.666446 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:36.666606 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:36.666614 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.667736 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.667740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:36.669034 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:36.669048 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.670880 (+ 1832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.670888 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:36.670990 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.671018 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 02:45:36.671770 (+ 752us) client_negotiation.cc:240] Negotiation successful
0812 02:45:36.671852 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":870,"thread_start_us":102,"threads_started":1}
I20260812 02:45:36.672560 7601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba4daf01ccde4ab1a6dd92480ebeea07" candidate_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" is_pre_election: true
I20260812 02:45:36.673206 7217 leader_election.cc:302] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2dfb264b589d495b9fcd6d5f6c7b907e; no voters: 3ab6f7bc8ee640f4b0fe5b635b61bd7a, c7e97718bd554fbf8fbc0df910f78b95
I20260812 02:45:36.673486 7729 raft_consensus.cc:2726] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 02:45:36.673916 6839 catalog_manager.cc:5495] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ab6f7bc8ee640f4b0fe5b635b61bd7a (127.10.75.67). New cstate: current_term: 1 leader_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } health_report { overall_health: HEALTHY } } }
I20260812 02:45:36.751020 7712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.747302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46100 (local address 127.10.75.67:34315)
0812 02:45:36.747454 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:36.747459 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:36.747483 (+ 24us) server_negotiation.cc:407] Connection header received
0812 02:45:36.747608 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:36.747610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:36.747666 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:36.747784 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:45:36.748049 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.748586 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.749458 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:36.749721 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:36.749838 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:36.750182 (+ 344us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:45:36.750592 (+ 410us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:45:36.750726 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:36.750782 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 02:45:36.750836 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 02:45:36.756852 7096 raft_consensus.cc:1261] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Refusing update from remote peer 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:45:36.756847 7340 raft_consensus.cc:1261] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 1 FOLLOWER]: Refusing update from remote peer 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:45:36.757469 7730 consensus_queue.cc:1035] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:45:36.757709 7740 consensus_queue.cc:1035] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:45:36.767076 7747 mvcc.cc:205] Tried to move back new op lower bound from 7317515209748955136 to 7317515209404473344. Current Snapshot: MvccSnapshot[applied={T|T < 7317515209748955136}]
I20260812 02:45:36.768473 7748 mvcc.cc:205] Tried to move back new op lower bound from 7317515209748955136 to 7317515209404473344. Current Snapshot: MvccSnapshot[applied={T|T < 7317515209748955136}]
I20260812 02:45:36.773233 6839 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46320:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:45:36.773427 6839 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46320:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:45:36.776034 6839 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28: Sending DeleteTablet for 3 replicas of tablet ba4daf01ccde4ab1a6dd92480ebeea07
I20260812 02:45:36.776925 7062 tablet_service.cc:1514] Processing DeleteTablet for tablet ba4daf01ccde4ab1a6dd92480ebeea07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:45:36 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:33796
I20260812 02:45:36.776976 7300 tablet_service.cc:1514] Processing DeleteTablet for tablet ba4daf01ccde4ab1a6dd92480ebeea07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:45:36 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:33004
I20260812 02:45:36.777433 7757 tablet_replica.cc:330] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95: stopping tablet replica
I20260812 02:45:36.777465 7758 tablet_replica.cc:330] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e: stopping tablet replica
I20260812 02:45:36.777652 7550 tablet_service.cc:1514] Processing DeleteTablet for tablet ba4daf01ccde4ab1a6dd92480ebeea07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:45:36 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:46092
I20260812 02:45:36.777756 7758 raft_consensus.cc:2229] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:45:36.777756 7757 raft_consensus.cc:2229] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:45:36.778048 7757 raft_consensus.cc:2258] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:45:36.778048 7758 raft_consensus.cc:2258] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:45:36.778263 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 6951
I20260812 02:45:36.793481 7758 ts_tablet_manager.cc:1905] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:45:36.797025 7758 ts_tablet_manager.cc:1918] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:45:36.797183 7758 log.cc:1196] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/ba4daf01ccde4ab1a6dd92480ebeea07
I20260812 02:45:36.797890 7758 ts_tablet_manager.cc:1939] T ba4daf01ccde4ab1a6dd92480ebeea07 P 2dfb264b589d495b9fcd6d5f6c7b907e: Deleting consensus metadata
I20260812 02:45:36.799523 6813 catalog_manager.cc:4841] TS 2dfb264b589d495b9fcd6d5f6c7b907e (127.10.75.66:45321): tablet ba4daf01ccde4ab1a6dd92480ebeea07 (table test-table [id=4b85c6ddd02d4c539dbda39cb8cea7ce]) successfully deleted
I20260812 02:45:36.800630 7762 tablet_replica.cc:330] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: stopping tablet replica
I20260812 02:45:36.801110 7762 raft_consensus.cc:2229] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:45:36.801831 7762 raft_consensus.cc:2258] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:45:36.803902 7762 ts_tablet_manager.cc:1905] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:45:36.808101 7762 ts_tablet_manager.cc:1918] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:45:36.808230 7762 log.cc:1196] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/ba4daf01ccde4ab1a6dd92480ebeea07
I20260812 02:45:36.808629 7762 ts_tablet_manager.cc:1939] T ba4daf01ccde4ab1a6dd92480ebeea07 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Deleting consensus metadata
I20260812 02:45:36.810168 6814 catalog_manager.cc:4841] TS 3ab6f7bc8ee640f4b0fe5b635b61bd7a (127.10.75.67:34315): tablet ba4daf01ccde4ab1a6dd92480ebeea07 (table test-table [id=4b85c6ddd02d4c539dbda39cb8cea7ce]) successfully deleted
W20260812 02:45:36.810335 6813 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.75.65:42303 (error 108)
I20260812 02:45:36.810623 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 7189
I20260812 02:45:36.811484 7709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:36.811158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:42303 (local address 127.0.0.1:33802)
0812 02:45:36.811332 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:36.811395 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.65:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
W20260812 02:45:36.811637 6813 catalog_manager.cc:4584] TS c7e97718bd554fbf8fbc0df910f78b95 (127.10.75.65:42303): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ba4daf01ccde4ab1a6dd92480ebeea07: Network error: Client connection negotiation failed: client connection to 127.10.75.65:42303: connect: Connection refused (error 111)
I20260812 02:45:36.824622 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 7433
I20260812 02:45:36.842756 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 6788
I20260812 02:45:56.860482 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:35201
--webserver_interface=127.10.75.126
--webserver_port=41899
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:35201
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:45:57.010987 7770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:57.011464 7770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:57.011559 7770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:57.016508 7770 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 02:45:57.016656 7770 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 02:45:57.016685 7770 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 02:45:57.016708 7770 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:45:57.016745 7770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:57.016791 7770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:57.016835 7770 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:45:57.016872 7770 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:45:57.023769 7770 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:35201
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:35201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=41899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:57.025501 7770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:57.027122 7770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:57.046597 7781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:57.046587 7783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:57.046586 7780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:57.046979 7770 server_base.cc:1034] running on GCE node
I20260812 02:45:57.048009 7770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:57.049850 7770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:57.051142 7770 hybrid_clock.cc:648] HybridClock initialized: now 1786502757051102 us; error 65 us; skew 500 ppm
Aug 12 02:45:57 dist-test-slave-2p8l krb5kdc[6765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502757, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:57.059087 7770 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:45:57.060595 7770 webserver.cc:460] Webserver started at http://127.10.75.126:41899/ using document root <none> and password file <none>
I20260812 02:45:57.061455 7770 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:57.061602 7770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:57.067327 7770 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s
I20260812 02:45:57.070546 7797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:57.072469 7770 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260812 02:45:57.072687 7770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "1c023ecc382a43da8d20e9e068f83c28"
format_stamp: "Formatted at 2026-08-12 02:45:35 on dist-test-slave-2p8l"
server_key: "25f71c9c15d2b3a2afe4aab9eb193d7c"
server_key_iv: "32f6045b8f842421c1e89e473f9c8a99"
server_key_version: "encryptionkey@0"
I20260812 02:45:57.073580 7770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:57.094485 7770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:57.098768 7770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:57.099092 7770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:57.108706 7770 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:35201
I20260812 02:45:57.109103 7890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:35201 every 8 connection(s)
I20260812 02:45:57.110339 7770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:45:57.113472 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 7770
I20260812 02:45:57.114114 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:42303
--local_ip_for_outbound_sockets=127.10.75.65
--tserver_master_addrs=127.10.75.126:35201
--webserver_port=43149
--webserver_interface=127.10.75.65
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:45:57.116797 7891 sys_catalog.cc:263] Verifying existing consensus state
I20260812 02:45:57.119335 7891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28: Bootstrap starting.
I20260812 02:45:57.143239 7891 log.cc:824] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:57.154910 7891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 02:45:57.155470 7891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28: Bootstrap complete.
I20260812 02:45:57.160701 7891 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c023ecc382a43da8d20e9e068f83c28" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35201 } }
I20260812 02:45:57.161285 7891 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c023ecc382a43da8d20e9e068f83c28, State: Initialized, Role: FOLLOWER
I20260812 02:45:57.161931 7891 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c023ecc382a43da8d20e9e068f83c28" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35201 } }
I20260812 02:45:57.162122 7891 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:45:57.162241 7891 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:45:57.162374 7891 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 1 FOLLOWER]: Advancing to term 2
I20260812 02:45:57.165066 7891 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c023ecc382a43da8d20e9e068f83c28" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35201 } }
I20260812 02:45:57.165548 7891 leader_election.cc:302] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c023ecc382a43da8d20e9e068f83c28; no voters:
I20260812 02:45:57.166034 7891 leader_election.cc:288] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 02:45:57.166208 7898 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 02:45:57.166432 7898 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 2 LEADER]: Becoming Leader. State: Replica: 1c023ecc382a43da8d20e9e068f83c28, State: Running, Role: LEADER
I20260812 02:45:57.166898 7898 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c023ecc382a43da8d20e9e068f83c28" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35201 } }
I20260812 02:45:57.167829 7891 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:45:57.168691 7904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c023ecc382a43da8d20e9e068f83c28. Latest consensus state: current_term: 2 leader_uuid: "1c023ecc382a43da8d20e9e068f83c28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c023ecc382a43da8d20e9e068f83c28" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35201 } } }
I20260812 02:45:57.168835 7904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [sys.catalog]: This master's current role is: LEADER
I20260812 02:45:57.169245 7901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1c023ecc382a43da8d20e9e068f83c28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c023ecc382a43da8d20e9e068f83c28" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35201 } } }
I20260812 02:45:57.169337 7901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [sys.catalog]: This master's current role is: LEADER
I20260812 02:45:57.170171 7910 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:45:57.176618 7910 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:45:57.177511 7910 catalog_manager.cc:1259] Loaded cluster ID: 6357d292b49e4ebd938b087b9d472d58
I20260812 02:45:57.177582 7910 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:45:57.180644 7910 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:45:57.181560 7910 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28: Loaded TSK: 0
I20260812 02:45:57.203064 7910 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28: Generated new TSK 1
I20260812 02:45:57.203511 7910 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 02:45:57.272567 7896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:57.272931 7896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:57.272985 7896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:57.277818 7896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:57.277936 7896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:57.278008 7896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:45:57.284698 7896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:42303
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=43149
--tserver_master_addrs=127.10.75.126:35201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:57.286479 7896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:57.288025 7896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:57.301496 7954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:57.301496 7946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:57.301496 7951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:57.302162 7896 server_base.cc:1034] running on GCE node
I20260812 02:45:57.302793 7896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:57.303748 7896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:57.305168 7896 hybrid_clock.cc:648] HybridClock initialized: now 1786502757305115 us; error 74 us; skew 500 ppm
Aug 12 02:45:57 dist-test-slave-2p8l krb5kdc[6765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502757, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:57.309326 7896 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:45:57.310942 7896 webserver.cc:460] Webserver started at http://127.10.75.65:43149/ using document root <none> and password file <none>
I20260812 02:45:57.311772 7896 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:57.311923 7896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:57.317648 7896 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260812 02:45:57.320783 7976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:57.322717 7896 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 02:45:57.322911 7896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "c7e97718bd554fbf8fbc0df910f78b95"
format_stamp: "Formatted at 2026-08-12 02:45:35 on dist-test-slave-2p8l"
server_key: "024123a5121087d39d283738e0bce080"
server_key_iv: "2f6d5ac0a688c4f21dd7ef1007a196b8"
server_key_version: "encryptionkey@0"
I20260812 02:45:57.323668 7896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:57.359408 7896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:57.364149 7896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:57.364482 7896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:57.365403 7896 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:57.367106 7992 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 02:45:57.373587 7896 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 02:45:57.373750 7896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260812 02:45:57.373859 7896 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 02:45:57.376545 7896 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 02:45:57.376657 7896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.001s sys 0.000s
I20260812 02:45:57.377089 7992 tablet_bootstrap.cc:492] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95: Bootstrap starting.
I20260812 02:45:57.391283 7896 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:42303
I20260812 02:45:57.391395 8219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:42303 every 8 connection(s)
I20260812 02:45:57.392804 7896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:45:57.396660 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 7896
I20260812 02:45:57.397338 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:45321
--local_ip_for_outbound_sockets=127.10.75.66
--tserver_master_addrs=127.10.75.126:35201
--webserver_port=33095
--webserver_interface=127.10.75.66
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:45:57.401793 7992 log.cc:824] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95: Log is configured to *not* fsync() on all Append() calls
Aug 12 02:45:57 dist-test-slave-2p8l krb5kdc[6765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502757, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:57.417173 7992 tablet_bootstrap.cc:492] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 02:45:57.417848 7992 tablet_bootstrap.cc:492] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95: Bootstrap complete.
I20260812 02:45:57.419308 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:57.395907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:51503)
0812 02:45:57.396926 (+ 1019us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:57.397023 (+ 97us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:57.398768 (+ 1745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:57.400719 (+ 1951us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:57.400730 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:57.401295 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:57.401902 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:57.401923 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.404057 (+ 2134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.404064 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:57.405766 (+ 1702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:57.405787 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.407289 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.407294 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:57.407515 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:57.408487 (+ 972us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:57.408514 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:57.411037 (+ 2523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:57.414567 (+ 3530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:57.414580 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:57.414605 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:57.415093 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:57.415693 (+ 600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:57.415697 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:57.415699 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:57.415901 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:57.416880 (+ 979us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:57.416888 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:57.417254 (+ 366us) client_negotiation.cc:769] Sending connection context
0812 02:45:57.417491 (+ 237us) client_negotiation.cc:240] Negotiation successful
0812 02:45:57.417952 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":213,"threads_started":1}
I20260812 02:45:57.419763 7992 ts_tablet_manager.cc:1397] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95: Time spent bootstrapping tablet: real 0.043s user 0.030s sys 0.008s
I20260812 02:45:57.419371 8223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:57.395895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:51503 (local address 127.10.75.126:35201)
0812 02:45:57.397900 (+ 2005us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:57.397929 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:57.398004 (+ 75us) server_negotiation.cc:407] Connection header received
0812 02:45:57.399510 (+ 1506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:57.399532 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:57.400165 (+ 633us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:57.400643 (+ 478us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:57.402199 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.403796 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.405997 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.407049 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.407330 (+ 281us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:57.411445 (+ 4115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:57.411454 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:57.411475 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:57.411526 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:57.414344 (+ 2818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:57.415293 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:57.415303 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:57.415309 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:57.415547 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:57.416054 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:57.416059 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:57.416061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:57.416725 (+ 664us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:57.416915 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:57.417706 (+ 791us) server_negotiation.cc:299] Negotiation successful
0812 02:45:57.418403 (+ 697us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1765,"thread_start_us":217,"threads_started":1}
I20260812 02:45:57.423409 8220 heartbeater.cc:347] Connected to a master server at 127.10.75.126:35201
I20260812 02:45:57.423779 8220 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:57.423374 7992 raft_consensus.cc:348] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } }
I20260812 02:45:57.424110 7992 raft_consensus.cc:729] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7e97718bd554fbf8fbc0df910f78b95, State: Initialized, Role: FOLLOWER
I20260812 02:45:57.424593 8220 heartbeater.cc:511] Master 127.10.75.126:35201 requested a full tablet report, sending...
I20260812 02:45:57.424808 7992 consensus_queue.cc:260] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } }
I20260812 02:45:57.426257 7992 ts_tablet_manager.cc:1428] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260812 02:45:57.428705 7827 ts_manager.cc:194] Registered new tserver with Master: c7e97718bd554fbf8fbc0df910f78b95 (127.10.75.65:42303)
I20260812 02:45:57.433434 7827 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:51503
I20260812 02:45:57.437179 8220 heartbeater.cc:503] Master 127.10.75.126:35201 was elected leader, sending a full tablet report...
Aug 12 02:45:57 dist-test-slave-2p8l krb5kdc[6765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502757, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for kudu/127.10.75.65@KRBTEST.COM
I20260812 02:45:57.447137 8235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:57.432798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:42303 (local address 127.0.0.1:51136)
0812 02:45:57.434003 (+ 1205us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:57.434095 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:57.434307 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:57.434981 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:57.434988 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:57.435554 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:57.435721 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:57.435731 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.437162 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.437166 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:57.438195 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:57.438209 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.438887 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.438890 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:57.439026 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:57.439755 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:57.439769 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:57.441855 (+ 2086us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:57.444827 (+ 2972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:57.444840 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:57.444847 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:57.445162 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:57.445589 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:57.445591 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:57.445593 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:57.445679 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:57.446425 (+ 746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:57.446431 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:57.446575 (+ 144us) client_negotiation.cc:769] Sending connection context
0812 02:45:57.446709 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 02:45:57.446934 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":992,"thread_start_us":201,"threads_started":1}
I20260812 02:45:57.447261 8238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:57.432954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51136 (local address 127.10.75.65:42303)
0812 02:45:57.433541 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:57.433557 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:57.434261 (+ 704us) server_negotiation.cc:407] Connection header received
0812 02:45:57.434516 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:57.434522 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:57.434774 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:57.434945 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:57.435901 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.436998 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.438331 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.438730 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.438866 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:57.442102 (+ 3236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:57.442120 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:57.442138 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:57.442175 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:57.444652 (+ 2477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:57.445317 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:57.445328 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:57.445333 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:57.445479 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:57.445775 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:57.445779 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:57.445781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:57.446285 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:57.446446 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:57.446832 (+ 386us) server_negotiation.cc:299] Negotiation successful
0812 02:45:57.447062 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":150,"threads_started":1}
I20260812 02:45:57.448704 8086 tablet_service.cc:1514] Processing DeleteTablet for tablet ba4daf01ccde4ab1a6dd92480ebeea07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:45:36 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:51136
I20260812 02:45:57.449883 8241 tablet_replica.cc:330] stopping tablet replica
I20260812 02:45:57.450363 8241 raft_consensus.cc:2229] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:45:57.450729 8241 raft_consensus.cc:2258] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:45:57.452286 8241 ts_tablet_manager.cc:1905] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:45:57.458732 8241 ts_tablet_manager.cc:1918] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:45:57.458921 8241 log.cc:1196] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/wal/wals/ba4daf01ccde4ab1a6dd92480ebeea07
I20260812 02:45:57.459302 8241 ts_tablet_manager.cc:1939] T ba4daf01ccde4ab1a6dd92480ebeea07 P c7e97718bd554fbf8fbc0df910f78b95: Deleting consensus metadata
I20260812 02:45:57.462185 7804 catalog_manager.cc:4841] TS c7e97718bd554fbf8fbc0df910f78b95 (127.10.75.65:42303): tablet ba4daf01ccde4ab1a6dd92480ebeea07 (table test-table [id=4b85c6ddd02d4c539dbda39cb8cea7ce]) successfully deleted
W20260812 02:45:57.557359 8231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:57.557768 8231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:57.557821 8231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:57.562529 8231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:57.562641 8231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:57.562713 8231 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:45:57.569329 8231 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:45321
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=33095
--tserver_master_addrs=127.10.75.126:35201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8231
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:57.571172 8231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:57.572535 8231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:57.585754 8247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:57.585754 8250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:57.585806 8248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:57.586148 8231 server_base.cc:1034] running on GCE node
I20260812 02:45:57.586822 8231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:57.587725 8231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:57.588920 8231 hybrid_clock.cc:648] HybridClock initialized: now 1786502757588900 us; error 34 us; skew 500 ppm
Aug 12 02:45:57 dist-test-slave-2p8l krb5kdc[6765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502757, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:57.592654 8231 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:45:57.594053 8231 webserver.cc:460] Webserver started at http://127.10.75.66:33095/ using document root <none> and password file <none>
I20260812 02:45:57.594950 8231 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:57.595059 8231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:57.600670 8231 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 02:45:57.603811 8262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:57.605674 8231 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 02:45:57.605861 8231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "2dfb264b589d495b9fcd6d5f6c7b907e"
format_stamp: "Formatted at 2026-08-12 02:45:36 on dist-test-slave-2p8l"
server_key: "5a1f07b709c8c1169cbb6c2e6533ecc0"
server_key_iv: "b18949ca10c150c2e9e854bdfe9d4bd3"
server_key_version: "encryptionkey@0"
I20260812 02:45:57.606705 8231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:57.634429 8231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:57.638655 8231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:57.638923 8231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:57.639756 8231 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:57.640872 8231 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:45:57.640928 8231 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:57.641013 8231 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:45:57.641055 8231 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:57.652859 8231 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:45321
I20260812 02:45:57.652894 8484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:45321 every 8 connection(s)
I20260812 02:45:57.654474 8231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:45:57.661381 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 8231
I20260812 02:45:57.661989 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:34315
--local_ip_for_outbound_sockets=127.10.75.67
--tserver_master_addrs=127.10.75.126:35201
--webserver_port=42361
--webserver_interface=127.10.75.67
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 02:45:57 dist-test-slave-2p8l krb5kdc[6765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502757, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:57.673301 8223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:57.657283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:37691 (local address 127.10.75.126:35201)
0812 02:45:57.657473 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:57.657477 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:57.658856 (+ 1379us) server_negotiation.cc:407] Connection header received
0812 02:45:57.660556 (+ 1700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:57.660560 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:57.660645 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:57.660776 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:57.663247 (+ 2471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.663957 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.665567 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.665825 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.665952 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:57.669245 (+ 3293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:57.669250 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:57.669253 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:57.669286 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:57.671024 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:57.671586 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:57.671590 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:57.671592 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:57.671678 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:57.672058 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:57.672062 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:57.672063 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:57.672257 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:57.672365 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:57.672939 (+ 574us) server_negotiation.cc:299] Negotiation successful
0812 02:45:57.673096 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 02:45:57.674341 8489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:57.657882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:37691)
0812 02:45:57.658638 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:57.658699 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:57.660243 (+ 1544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:57.661274 (+ 1031us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:57.661285 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:57.661952 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:57.662781 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:57.662801 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.664214 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.664218 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:57.665406 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:57.665419 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.666030 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.666035 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:57.666291 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:57.667037 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:57.667057 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:57.668990 (+ 1933us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:57.671155 (+ 2165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:57.671161 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:57.671178 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:57.671463 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:57.671777 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:57.671780 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:57.671782 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:57.671942 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:57.672384 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:57.672391 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:57.672676 (+ 285us) client_negotiation.cc:769] Sending connection context
0812 02:45:57.672881 (+ 205us) client_negotiation.cc:240] Negotiation successful
0812 02:45:57.673265 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":268,"threads_started":1}
I20260812 02:45:57.675894 8487 heartbeater.cc:347] Connected to a master server at 127.10.75.126:35201
I20260812 02:45:57.676235 8487 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:57.676890 8487 heartbeater.cc:511] Master 127.10.75.126:35201 requested a full tablet report, sending...
I20260812 02:45:57.678318 7827 ts_manager.cc:194] Registered new tserver with Master: 2dfb264b589d495b9fcd6d5f6c7b907e (127.10.75.66:45321)
I20260812 02:45:57.679131 7827 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:37691
W20260812 02:45:57.787468 8490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:45:57.787707 8490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:45:57.787748 8490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:45:57.791585 8490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:45:57.791635 8490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:45:57.791689 8490 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:45:57.796656 8490 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:34315
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=42361
--tserver_master_addrs=127.10.75.126:35201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:45:57.797631 8490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:45:57.798686 8490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:45:57.808679 8503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:45:57.808676 8502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:57.808979 8490 server_base.cc:1034] running on GCE node
W20260812 02:45:57.808691 8505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:45:57.809599 8490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:45:57.810500 8490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:45:57.811674 8490 hybrid_clock.cc:648] HybridClock initialized: now 1786502757811656 us; error 32 us; skew 500 ppm
Aug 12 02:45:57 dist-test-slave-2p8l krb5kdc[6765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502757, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:45:57.814587 8490 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:45:57.815806 8490 webserver.cc:460] Webserver started at http://127.10.75.67:42361/ using document root <none> and password file <none>
I20260812 02:45:57.816457 8490 fs_manager.cc:359] Metadata directory not provided
I20260812 02:45:57.816569 8490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:45:57.820601 8490 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 02:45:57.822981 8519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:57.824381 8490 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 02:45:57.824566 8490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a"
format_stamp: "Formatted at 2026-08-12 02:45:36 on dist-test-slave-2p8l"
server_key: "82c33fe683287bf169b9a7d0e15ee230"
server_key_iv: "0affd5d825688ea8e841766b7962d427"
server_key_version: "encryptionkey@0"
I20260812 02:45:57.825147 8490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:45:57.846324 8490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:45:57.849849 8490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:45:57.850145 8490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:45:57.850926 8490 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:45:57.851856 8490 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:45:57.851940 8490 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:57.852017 8490 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:45:57.852072 8490 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:45:57.862655 8490 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:34315
I20260812 02:45:57.862694 8735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:34315 every 8 connection(s)
I20260812 02:45:57.863744 8490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:45:57.870919 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 8490
Aug 12 02:45:57 dist-test-slave-2p8l krb5kdc[6765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502757, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:45:57.879410 8223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:57.865751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:37667 (local address 127.10.75.126:35201)
0812 02:45:57.865915 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:57.865924 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:57.866718 (+ 794us) server_negotiation.cc:407] Connection header received
0812 02:45:57.868270 (+ 1552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:57.868273 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:57.868326 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:57.868413 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:57.869834 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.870499 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.871780 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.872086 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.872214 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:57.875131 (+ 2917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:57.875135 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:57.875140 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:57.875170 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:57.877069 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:57.877683 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:57.877686 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:57.877687 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:57.877775 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:57.878272 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:57.878276 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:57.878278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:57.878455 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:57.878601 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:57.879095 (+ 494us) server_negotiation.cc:299] Negotiation successful
0812 02:45:57.879236 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64,"spinlock_wait_cycles":768}
I20260812 02:45:57.880189 8739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:57.866100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:37667)
0812 02:45:57.866558 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:57.866602 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:57.868021 (+ 1419us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:57.868621 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:57.868628 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:57.869113 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:45:57.869684 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:57.869699 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.870645 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.870648 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:57.871657 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:57.871667 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.872302 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.872307 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:57.872534 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:57.873247 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:45:57.873271 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:45:57.874955 (+ 1684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:45:57.877220 (+ 2265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:57.877225 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:57.877238 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:57.877576 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:57.877885 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:45:57.877888 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:45:57.877890 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:45:57.878171 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:45:57.878582 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:45:57.878590 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:45:57.878831 (+ 241us) client_negotiation.cc:769] Sending connection context
0812 02:45:57.879011 (+ 180us) client_negotiation.cc:240] Negotiation successful
0812 02:45:57.879338 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":115,"threads_started":1}
I20260812 02:45:57.881526 8736 heartbeater.cc:347] Connected to a master server at 127.10.75.126:35201
I20260812 02:45:57.881749 8736 heartbeater.cc:464] Registering TS with master...
I20260812 02:45:57.882237 8740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:57.871663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57026 (local address 127.10.75.126:35201)
0812 02:45:57.871940 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:57.871944 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:57.872132 (+ 188us) server_negotiation.cc:407] Connection header received
0812 02:45:57.872275 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:57.872278 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:57.872322 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:57.872400 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:57.873474 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.874018 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.875141 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.875453 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.875595 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:57.877728 (+ 2133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:57.877731 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:57.877733 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:57.877769 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:57.879818 (+ 2049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:57.880310 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:57.880313 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:57.880316 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:57.880440 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:57.880778 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:57.880781 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:57.880782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:57.880953 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:57.881200 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:57.881282 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 02:45:57.881406 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"spinlock_wait_cycles":768,"thread_start_us":112,"threads_started":1}
I20260812 02:45:57.882279 8736 heartbeater.cc:511] Master 127.10.75.126:35201 requested a full tablet report, sending...
I20260812 02:45:57.883504 7827 ts_manager.cc:194] Registered new tserver with Master: 3ab6f7bc8ee640f4b0fe5b635b61bd7a (127.10.75.67:34315)
I20260812 02:45:57.884058 7827 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:37667
I20260812 02:45:57.884356 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:45:57.889376 8740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:57.885027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57038 (local address 127.10.75.126:35201)
0812 02:45:57.885158 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:57.885163 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:57.886360 (+ 1197us) server_negotiation.cc:407] Connection header received
0812 02:45:57.886462 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:57.886464 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:57.886554 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:57.886642 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:45:57.886855 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.887405 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.888249 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.888487 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.888593 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:57.888886 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:45:57.889008 (+ 122us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 02:45:57.889248 (+ 240us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57038: token expired
Metrics: {"server-negotiator.queue_time_us":58}
W20260812 02:45:57.889448 8740 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57038: token expired
W20260812 02:45:57.889858 7688 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.10.75.126:35201)
I20260812 02:45:57.896957 8740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:57.890264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57054 (local address 127.10.75.126:35201)
0812 02:45:57.890382 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:57.890386 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:57.890398 (+ 12us) server_negotiation.cc:407] Connection header received
0812 02:45:57.890475 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:57.890477 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:57.890509 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:57.890572 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:45:57.891145 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.891620 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.892374 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.892580 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.892658 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:57.893956 (+ 1298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:45:57.893959 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:45:57.893961 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:45:57.893982 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:45:57.895509 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:57.895898 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:57.895901 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:57.895902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:57.895975 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:45:57.896226 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:45:57.896228 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:45:57.896229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:45:57.896380 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:45:57.896476 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:57.896668 (+ 192us) server_negotiation.cc:299] Negotiation successful
0812 02:45:57.896759 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 02:45:57.899415 7827 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57054:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:45:57.902854 7827 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:45:57.911240 8086 tablet_service.cc:1467] Processing CreateTablet for tablet 6f7d174cf16a406d97caccde783418a9 (DEFAULT_TABLE table=test-table [id=e84e3a23b3634a85b33d86d3ce75e607]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:45:57.912007 8086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f7d174cf16a406d97caccde783418a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:57.915112 7992 tablet_bootstrap.cc:492] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95: Bootstrap starting.
I20260812 02:45:57.916090 7992 tablet_bootstrap.cc:654] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:57.916162 8235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:57.909910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:45321 (local address 127.0.0.1:48868)
0812 02:45:57.910039 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:57.910055 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:57.910190 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:57.911266 (+ 1076us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:57.911270 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:57.911293 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:57.911406 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:57.911414 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.912923 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.912930 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:57.914435 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:57.914446 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.915624 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.915627 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:57.915811 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:57.915865 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 02:45:57.915930 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 02:45:57.916018 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 02:45:57.916735 8756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:57.910215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:34315 (local address 127.0.0.1:39628)
0812 02:45:57.910589 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:57.910603 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:57.910699 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:57.911511 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:57.911514 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:57.911532 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:57.911624 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:57.911630 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.913598 (+ 1968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.913601 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:57.914822 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:57.914836 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.916324 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.916328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:57.916421 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:57.916445 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 02:45:57.916511 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 02:45:57.916591 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":95,"threads_started":1}
I20260812 02:45:57.917002 8752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:57.910112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48868 (local address 127.10.75.66:45321)
0812 02:45:57.910705 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:57.910721 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:57.910749 (+ 28us) server_negotiation.cc:407] Connection header received
0812 02:45:57.910845 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:57.910853 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:57.911086 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:57.911334 (+ 248us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:57.911540 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.912798 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.914577 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.915455 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.916352 (+ 897us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:57.916530 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:57.916595 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 02:45:57.916694 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":170,"threads_started":1}
I20260812 02:45:57.917444 8757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:57.910659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39628 (local address 127.10.75.67:34315)
0812 02:45:57.911048 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:57.911060 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:57.911081 (+ 21us) server_negotiation.cc:407] Connection header received
0812 02:45:57.911152 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:57.911157 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:57.911332 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:57.911788 (+ 456us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:57.912101 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.913461 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.914973 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:57.916153 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:57.916947 (+ 794us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:57.917137 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:57.917195 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 02:45:57.917300 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":173,"threads_started":1}
I20260812 02:45:57.917687 7992 tablet_bootstrap.cc:492] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95: No bootstrap required, opened a new log
I20260812 02:45:57.917821 7992 ts_tablet_manager.cc:1397] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 02:45:57.918341 7992 raft_consensus.cc:348] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } }
I20260812 02:45:57.918465 7992 raft_consensus.cc:374] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:57.918505 7992 raft_consensus.cc:729] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7e97718bd554fbf8fbc0df910f78b95, State: Initialized, Role: FOLLOWER
I20260812 02:45:57.918632 7992 consensus_queue.cc:260] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } }
I20260812 02:45:57.919348 7992 ts_tablet_manager.cc:1428] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260812 02:45:57.920240 8612 tablet_service.cc:1467] Processing CreateTablet for tablet 6f7d174cf16a406d97caccde783418a9 (DEFAULT_TABLE table=test-table [id=e84e3a23b3634a85b33d86d3ce75e607]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:45:57.920362 8349 tablet_service.cc:1467] Processing CreateTablet for tablet 6f7d174cf16a406d97caccde783418a9 (DEFAULT_TABLE table=test-table [id=e84e3a23b3634a85b33d86d3ce75e607]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:45:57.921211 8612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f7d174cf16a406d97caccde783418a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:57.921514 8349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f7d174cf16a406d97caccde783418a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:45:57.928344 8760 tablet_bootstrap.cc:492] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e: Bootstrap starting.
I20260812 02:45:57.928345 8761 tablet_bootstrap.cc:492] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Bootstrap starting.
I20260812 02:45:57.930577 8761 tablet_bootstrap.cc:654] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:57.931053 8760 tablet_bootstrap.cc:654] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e: Neither blocks nor log segments found. Creating new log.
I20260812 02:45:57.931880 8761 log.cc:824] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:57.931880 8760 log.cc:824] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e: Log is configured to *not* fsync() on all Append() calls
I20260812 02:45:57.933622 8760 tablet_bootstrap.cc:492] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e: No bootstrap required, opened a new log
I20260812 02:45:57.933640 8761 tablet_bootstrap.cc:492] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: No bootstrap required, opened a new log
I20260812 02:45:57.933835 8760 ts_tablet_manager.cc:1397] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 02:45:57.933840 8761 ts_tablet_manager.cc:1397] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 02:45:57.936730 8760 raft_consensus.cc:348] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } }
I20260812 02:45:57.936729 8761 raft_consensus.cc:348] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } }
I20260812 02:45:57.937021 8760 raft_consensus.cc:374] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:57.937021 8761 raft_consensus.cc:374] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:45:57.937080 8760 raft_consensus.cc:729] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dfb264b589d495b9fcd6d5f6c7b907e, State: Initialized, Role: FOLLOWER
I20260812 02:45:57.937083 8761 raft_consensus.cc:729] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ab6f7bc8ee640f4b0fe5b635b61bd7a, State: Initialized, Role: FOLLOWER
I20260812 02:45:57.937547 8761 consensus_queue.cc:260] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } }
I20260812 02:45:57.937536 8760 consensus_queue.cc:260] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } }
I20260812 02:45:57.938237 8736 heartbeater.cc:503] Master 127.10.75.126:35201 was elected leader, sending a full tablet report...
I20260812 02:45:57.938237 8487 heartbeater.cc:503] Master 127.10.75.126:35201 was elected leader, sending a full tablet report...
I20260812 02:45:57.938602 8761 ts_tablet_manager.cc:1428] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 02:45:57.939631 8760 ts_tablet_manager.cc:1428] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 02:45:58.051625 8233 raft_consensus.cc:482] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:45:58.051884 8233 raft_consensus.cc:504] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } }
I20260812 02:45:58.053095 8233 leader_election.cc:288] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dfb264b589d495b9fcd6d5f6c7b907e (127.10.75.66:45321), 3ab6f7bc8ee640f4b0fe5b635b61bd7a (127.10.75.67:34315)
I20260812 02:45:58.058712 8757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:58.053619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:35499 (local address 127.10.75.67:34315)
0812 02:45:58.053748 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:58.053752 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:58.053941 (+ 189us) server_negotiation.cc:407] Connection header received
0812 02:45:58.054178 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:58.054184 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:58.054263 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:58.054349 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:58.054752 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:58.055236 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:58.057173 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:58.057898 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:58.058017 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:58.058101 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:58.058479 (+ 378us) server_negotiation.cc:299] Negotiation successful
0812 02:45:58.058569 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 02:45:58.058704 8752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:58.053544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:47629 (local address 127.10.75.66:45321)
0812 02:45:58.053685 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:58.053691 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:58.054034 (+ 343us) server_negotiation.cc:407] Connection header received
0812 02:45:58.054228 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:58.054233 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:58.054340 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:58.054424 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:45:58.054717 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:58.055349 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:58.057166 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:58.057859 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:58.058044 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:58.058125 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:58.058479 (+ 354us) server_negotiation.cc:299] Negotiation successful
0812 02:45:58.058569 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 02:45:58.058744 8767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:58.053395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:34315 (local address 127.10.75.65:35499)
0812 02:45:58.053833 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:58.053847 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:58.053966 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:58.054379 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:58.054385 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:58.054413 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:58.054616 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:58.054624 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:58.055386 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:58.055390 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:58.056998 (+ 1608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:58.057007 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:58.058028 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:58.058033 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:58.058234 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:58.058331 (+ 97us) client_negotiation.cc:769] Sending connection context
0812 02:45:58.058418 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 02:45:58.058546 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":291,"thread_start_us":114,"threads_started":1}
I20260812 02:45:58.058764 8770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:58.053395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:45321 (local address 127.10.75.65:47629)
0812 02:45:58.053880 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:58.053915 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 02:45:58.054037 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:45:58.054484 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:45:58.054486 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:45:58.054502 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:45:58.054575 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:58.054580 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:58.055452 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:58.055455 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:58.056993 (+ 1538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:45:58.057007 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:45:58.058028 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:45:58.058033 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:45:58.058232 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:58.058336 (+ 104us) client_negotiation.cc:769] Sending connection context
0812 02:45:58.058418 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 02:45:58.058550 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"mutex_wait_us":364,"thread_start_us":83,"threads_started":1}
I20260812 02:45:58.059695 8657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f7d174cf16a406d97caccde783418a9" candidate_uuid: "c7e97718bd554fbf8fbc0df910f78b95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" is_pre_election: true
I20260812 02:45:58.059692 8395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f7d174cf16a406d97caccde783418a9" candidate_uuid: "c7e97718bd554fbf8fbc0df910f78b95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" is_pre_election: true
I20260812 02:45:58.060014 8395 raft_consensus.cc:2454] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7e97718bd554fbf8fbc0df910f78b95 in term 0.
I20260812 02:45:58.060014 8657 raft_consensus.cc:2454] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7e97718bd554fbf8fbc0df910f78b95 in term 0.
I20260812 02:45:58.060547 7982 leader_election.cc:302] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dfb264b589d495b9fcd6d5f6c7b907e, c7e97718bd554fbf8fbc0df910f78b95; no voters:
I20260812 02:45:58.060848 8233 raft_consensus.cc:2781] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:45:58.060969 8233 raft_consensus.cc:482] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:45:58.061028 8233 raft_consensus.cc:3037] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:58.062173 8233 raft_consensus.cc:504] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } }
I20260812 02:45:58.062534 8233 leader_election.cc:288] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 1 election: Requested vote from peers 2dfb264b589d495b9fcd6d5f6c7b907e (127.10.75.66:45321), 3ab6f7bc8ee640f4b0fe5b635b61bd7a (127.10.75.67:34315)
I20260812 02:45:58.062943 8395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f7d174cf16a406d97caccde783418a9" candidate_uuid: "c7e97718bd554fbf8fbc0df910f78b95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e"
I20260812 02:45:58.062958 8657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f7d174cf16a406d97caccde783418a9" candidate_uuid: "c7e97718bd554fbf8fbc0df910f78b95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a"
I20260812 02:45:58.063076 8657 raft_consensus.cc:3037] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:58.063076 8395 raft_consensus.cc:3037] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:45:58.064356 8657 raft_consensus.cc:2454] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7e97718bd554fbf8fbc0df910f78b95 in term 1.
I20260812 02:45:58.064356 8395 raft_consensus.cc:2454] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7e97718bd554fbf8fbc0df910f78b95 in term 1.
I20260812 02:45:58.064735 7983 leader_election.cc:302] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ab6f7bc8ee640f4b0fe5b635b61bd7a, c7e97718bd554fbf8fbc0df910f78b95; no voters:
I20260812 02:45:58.064919 8233 raft_consensus.cc:2781] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:45:58.065178 8233 raft_consensus.cc:686] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 LEADER]: Becoming Leader. State: Replica: c7e97718bd554fbf8fbc0df910f78b95, State: Running, Role: LEADER
I20260812 02:45:58.065451 8233 consensus_queue.cc:237] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } }
I20260812 02:45:58.068593 7825 catalog_manager.cc:5495] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7e97718bd554fbf8fbc0df910f78b95 (127.10.75.65). New cstate: current_term: 1 leader_uuid: "c7e97718bd554fbf8fbc0df910f78b95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } health_report { overall_health: HEALTHY } } }
I20260812 02:45:58.110428 8775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:58.106318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51152 (local address 127.10.75.65:42303)
0812 02:45:58.106590 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0812 02:45:58.106598 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 02:45:58.106614 (+ 16us) server_negotiation.cc:407] Connection header received
0812 02:45:58.106687 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:45:58.106689 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:45:58.106741 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:45:58.106843 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:45:58.107127 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:58.107682 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:58.108606 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:45:58.108947 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:45:58.109061 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:45:58.109374 (+ 313us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:45:58.109894 (+ 520us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:45:58.110011 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 02:45:58.110205 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 02:45:58.110267 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":112,"threads_started":1}
W20260812 02:45:58.114773 8738 tablet.cc:2369] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:45:58.115037 8657 raft_consensus.cc:1261] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 1 FOLLOWER]: Refusing update from remote peer c7e97718bd554fbf8fbc0df910f78b95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:45:58.115043 8395 raft_consensus.cc:1261] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 1 FOLLOWER]: Refusing update from remote peer c7e97718bd554fbf8fbc0df910f78b95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:45:58.115736 8233 consensus_queue.cc:1035] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:45:58.115921 8771 consensus_queue.cc:1035] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:45:58.123973 8776 mvcc.cc:205] Tried to move back new op lower bound from 7317515297231941632 to 7317515297038987264. Current Snapshot: MvccSnapshot[applied={T|T < 7317515297231941632}]
I20260812 02:45:58.126166 8779 mvcc.cc:205] Tried to move back new op lower bound from 7317515297231941632 to 7317515297038987264. Current Snapshot: MvccSnapshot[applied={T|T < 7317515297231941632}]
I20260812 02:45:58.128357 8778 mvcc.cc:205] Tried to move back new op lower bound from 7317515297231941632 to 7317515297038987264. Current Snapshot: MvccSnapshot[applied={T|T < 7317515297231941632}]
I20260812 02:45:58.134462 7825 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:45:58.134608 7825 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:45:58.136888 7825 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28: Sending DeleteTablet for 3 replicas of tablet 6f7d174cf16a406d97caccde783418a9
I20260812 02:45:58.137552 8349 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f7d174cf16a406d97caccde783418a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:45:58 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:48868
I20260812 02:45:58.137713 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 7896
I20260812 02:45:58.137651 8612 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f7d174cf16a406d97caccde783418a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:45:58 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:39628
I20260812 02:45:58.141938 8795 tablet_replica.cc:330] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e: stopping tablet replica
I20260812 02:45:58.142331 8795 raft_consensus.cc:2229] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:45:58.142699 8795 raft_consensus.cc:2258] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:45:58.144773 8797 tablet_replica.cc:330] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: stopping tablet replica
I20260812 02:45:58.145102 8797 raft_consensus.cc:2229] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:45:58.145382 8797 raft_consensus.cc:2258] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:45:58.145655 8795 ts_tablet_manager.cc:1905] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:45:58.146643 8797 ts_tablet_manager.cc:1905] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:45:58.148710 8797 ts_tablet_manager.cc:1918] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:45:58.148829 8797 log.cc:1196] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/6f7d174cf16a406d97caccde783418a9
I20260812 02:45:58.149163 8797 ts_tablet_manager.cc:1939] T 6f7d174cf16a406d97caccde783418a9 P 3ab6f7bc8ee640f4b0fe5b635b61bd7a: Deleting consensus metadata
I20260812 02:45:58.149205 8795 ts_tablet_manager.cc:1918] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:45:58.149307 8795 log.cc:1196] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/6f7d174cf16a406d97caccde783418a9
I20260812 02:45:58.149673 8795 ts_tablet_manager.cc:1939] T 6f7d174cf16a406d97caccde783418a9 P 2dfb264b589d495b9fcd6d5f6c7b907e: Deleting consensus metadata
I20260812 02:45:58.150434 7805 catalog_manager.cc:4841] TS 3ab6f7bc8ee640f4b0fe5b635b61bd7a (127.10.75.67:34315): tablet 6f7d174cf16a406d97caccde783418a9 (table test-table [id=e84e3a23b3634a85b33d86d3ce75e607]) successfully deleted
I20260812 02:45:58.150825 7804 catalog_manager.cc:4841] TS 2dfb264b589d495b9fcd6d5f6c7b907e (127.10.75.66:45321): tablet 6f7d174cf16a406d97caccde783418a9 (table test-table [id=e84e3a23b3634a85b33d86d3ce75e607]) successfully deleted
W20260812 02:45:58.152201 7804 connection.cc:535] client connection to 127.10.75.65:42303 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 02:45:58.152376 7804 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 02:45:58.152522 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 8231
I20260812 02:45:58.157791 8756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:45:58.157509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:42303 (local address 127.0.0.1:51154)
0812 02:45:58.157649 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 02:45:58.157717 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.65:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 02:45:58.157953 7804 catalog_manager.cc:4584] TS c7e97718bd554fbf8fbc0df910f78b95 (127.10.75.65:42303): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6f7d174cf16a406d97caccde783418a9: Network error: Client connection negotiation failed: client connection to 127.10.75.65:42303: connect: Connection refused (error 111)
I20260812 02:45:58.169974 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 8490
I20260812 02:45:58.184703 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 7770
I20260812 02:46:18.207835 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:35201
--webserver_interface=127.10.75.126
--webserver_port=41899
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:35201
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:18.351991 8801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:18.352387 8801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:18.352435 8801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:18.357359 8801 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 02:46:18.357463 8801 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 02:46:18.357481 8801 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 02:46:18.357497 8801 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:46:18.357518 8801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:18.357537 8801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:18.357600 8801 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:46:18.357635 8801 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:46:18.364430 8801 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:35201
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:35201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=41899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:18.366170 8801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:18.367583 8801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:18.378445 8817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:18.378453 8810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:18.378439 8811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:18.378779 8801 server_base.cc:1034] running on GCE node
I20260812 02:46:18.379673 8801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:18.381189 8801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:18.382406 8801 hybrid_clock.cc:648] HybridClock initialized: now 1786502778382374 us; error 62 us; skew 500 ppm
Aug 12 02:46:18 dist-test-slave-2p8l krb5kdc[6765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502778, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:18.385968 8801 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:46:18.387187 8801 webserver.cc:460] Webserver started at http://127.10.75.126:41899/ using document root <none> and password file <none>
I20260812 02:46:18.387938 8801 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:18.388047 8801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:18.393085 8801 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.004s
I20260812 02:46:18.395926 8826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:18.397527 8801 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 02:46:18.397725 8801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "1c023ecc382a43da8d20e9e068f83c28"
format_stamp: "Formatted at 2026-08-12 02:45:35 on dist-test-slave-2p8l"
server_key: "25f71c9c15d2b3a2afe4aab9eb193d7c"
server_key_iv: "32f6045b8f842421c1e89e473f9c8a99"
server_key_version: "encryptionkey@0"
I20260812 02:46:18.398531 8801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:18.417167 8801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:18.421175 8801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:18.421460 8801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:18.431151 8801 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:35201
I20260812 02:46:18.431501 8931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:35201 every 8 connection(s)
I20260812 02:46:18.432706 8801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:46:18.438649 8932 sys_catalog.cc:263] Verifying existing consensus state
I20260812 02:46:18.439612 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 8801
I20260812 02:46:18.440258 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:42303
--local_ip_for_outbound_sockets=127.10.75.65
--tserver_master_addrs=127.10.75.126:35201
--webserver_port=43149
--webserver_interface=127.10.75.65
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:46:18.441515 8932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28: Bootstrap starting.
I20260812 02:46:18.465014 8932 log.cc:824] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:18.478261 8932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 02:46:18.478786 8932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28: Bootstrap complete.
I20260812 02:46:18.483789 8932 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c023ecc382a43da8d20e9e068f83c28" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35201 } }
I20260812 02:46:18.484272 8932 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c023ecc382a43da8d20e9e068f83c28, State: Initialized, Role: FOLLOWER
I20260812 02:46:18.484921 8932 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c023ecc382a43da8d20e9e068f83c28" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35201 } }
I20260812 02:46:18.485055 8932 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:46:18.485155 8932 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:46:18.485255 8932 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 2 FOLLOWER]: Advancing to term 3
I20260812 02:46:18.487784 8932 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c023ecc382a43da8d20e9e068f83c28" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35201 } }
I20260812 02:46:18.488191 8932 leader_election.cc:302] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c023ecc382a43da8d20e9e068f83c28; no voters:
I20260812 02:46:18.488652 8932 leader_election.cc:288] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 02:46:18.488765 8942 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 02:46:18.489002 8942 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [term 3 LEADER]: Becoming Leader. State: Replica: 1c023ecc382a43da8d20e9e068f83c28, State: Running, Role: LEADER
I20260812 02:46:18.489434 8942 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c023ecc382a43da8d20e9e068f83c28" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35201 } }
I20260812 02:46:18.490226 8932 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:46:18.491091 8947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "1c023ecc382a43da8d20e9e068f83c28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c023ecc382a43da8d20e9e068f83c28" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35201 } } }
I20260812 02:46:18.491245 8947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:18.492095 8948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c023ecc382a43da8d20e9e068f83c28. Latest consensus state: current_term: 3 leader_uuid: "1c023ecc382a43da8d20e9e068f83c28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c023ecc382a43da8d20e9e068f83c28" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 35201 } } }
I20260812 02:46:18.492240 8948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28 [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:18.492811 8956 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:46:18.497984 8956 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:46:18.498618 8956 catalog_manager.cc:1259] Loaded cluster ID: 6357d292b49e4ebd938b087b9d472d58
I20260812 02:46:18.498695 8956 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:46:18.500712 8956 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:46:18.501400 8956 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28: Loaded TSK: 0
I20260812 02:46:18.501492 8956 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1c023ecc382a43da8d20e9e068f83c28: Loaded TSK: 1
F20260812 02:46:18.502380 8956 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f8be42389ad google::LogMessage::Fail() at ??:0
@ 0x7f8be423b88a google::LogMessage::SendToLog() at ??:0
@ 0x7f8be42384de google::LogMessage::Flush() at ??:0
@ 0x7f8be4239a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f8be6efc18d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f8be6ef4f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f8beeb9d7bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f8beeb7799c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f8beeb78178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f8beebb9df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f8beebd882b std::function<>::operator()() at ??:0
@ 0x7f8beeb77b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f8beeb78f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f8beeb75579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f8beebb9640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f8be648a3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8be648ac83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f8be648c3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f8be647b512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8be7abf6db start_thread at ??:0
@ 0x7f8be2d3661f clone at ??:0
W20260812 02:46:18.620034 8940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:18.620532 8940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:18.620615 8940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:18.628382 8940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:18.628518 8940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:18.628643 8940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:46:18.638190 8940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:42303
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=43149
--tserver_master_addrs=127.10.75.126:35201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:18.640327 8940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:18.642359 8940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:18.658675 9022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:18.658696 9021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:18.658985 8940 server_base.cc:1034] running on GCE node
W20260812 02:46:18.659237 9032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:18.659900 8940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:18.661001 8940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:18.662209 8940 hybrid_clock.cc:648] HybridClock initialized: now 1786502778662166 us; error 66 us; skew 500 ppm
Aug 12 02:46:18 dist-test-slave-2p8l krb5kdc[6765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502778, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:18.666452 8940 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:46:18.667682 8940 webserver.cc:460] Webserver started at http://127.10.75.65:43149/ using document root <none> and password file <none>
I20260812 02:46:18.668462 8940 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:18.668535 8940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:18.673915 8940 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.000s
I20260812 02:46:18.677033 9045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:18.679065 8940 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 02:46:18.679244 8940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "c7e97718bd554fbf8fbc0df910f78b95"
format_stamp: "Formatted at 2026-08-12 02:45:35 on dist-test-slave-2p8l"
server_key: "024123a5121087d39d283738e0bce080"
server_key_iv: "2f6d5ac0a688c4f21dd7ef1007a196b8"
server_key_version: "encryptionkey@0"
I20260812 02:46:18.679987 8940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:18.706437 8940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:18.710831 8940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:18.711118 8940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:18.712024 8940 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:18.713531 9059 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 02:46:18.720865 8940 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 02:46:18.721009 8940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.008s user 0.001s sys 0.000s
I20260812 02:46:18.721108 8940 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 02:46:18.724542 8940 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 02:46:18.724632 8940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.001s sys 0.000s
I20260812 02:46:18.725642 9059 tablet_bootstrap.cc:492] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95: Bootstrap starting.
I20260812 02:46:18.742906 8940 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:42303
I20260812 02:46:18.744163 8940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:46:18.745183 9266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:42303 every 8 connection(s)
I20260812 02:46:18.752501 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 8940
I20260812 02:46:18.753122 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:45321
--local_ip_for_outbound_sockets=127.10.75.66
--tserver_master_addrs=127.10.75.126:35201
--webserver_port=33095
--webserver_interface=127.10.75.66
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:46:18.755842 9059 log.cc:824] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:18.768548 9059 tablet_bootstrap.cc:492] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 02:46:18.769222 9059 tablet_bootstrap.cc:492] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95: Bootstrap complete.
I20260812 02:46:18.771066 9059 ts_tablet_manager.cc:1397] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95: Time spent bootstrapping tablet: real 0.046s user 0.031s sys 0.012s
I20260812 02:46:18.775445 9059 raft_consensus.cc:348] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } }
I20260812 02:46:18.776144 9059 raft_consensus.cc:729] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7e97718bd554fbf8fbc0df910f78b95, State: Initialized, Role: FOLLOWER
I20260812 02:46:18.776891 9059 consensus_queue.cc:260] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } }
I20260812 02:46:18.778578 9059 ts_tablet_manager.cc:1428] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95: Time spent starting tablet: real 0.007s user 0.007s sys 0.001s
W20260812 02:46:18.836742 9271 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:46:18.747019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:53369)
0812 02:46:18.747690 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:18.747769 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:18.748824 (+ 1055us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:18.835620 (+ 86796us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":205,"threads_started":1}
W20260812 02:46:18.837399 9268 heartbeater.cc:644] Failed to heartbeat to 127.10.75.126:35201 (0 consecutive failures): Network error: Failed to ping master at 127.10.75.126:35201: Client connection negotiation failed: client connection to 127.10.75.126:35201: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 02:46:18.838471 9271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:18.838154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:39033)
0812 02:46:18.838317 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:18.838398 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 02:46:18.839201 9271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:18.838982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:60893)
0812 02:46:18.839094 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:18.839151 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 02:46:18.839396 9268 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 02:46:18.915617 9272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:18.916054 9272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:18.916158 9272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:18.920673 9272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:18.920795 9272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:18.920926 9272 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:46:18.927083 9272 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:45321
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=33095
--tserver_master_addrs=127.10.75.126:35201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9272
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:18.928684 9272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:18.930132 9272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:18.942468 9283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:18.942468 9293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:18.942592 9285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:18.943096 9272 server_base.cc:1034] running on GCE node
I20260812 02:46:18.943681 9272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:18.944621 9272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:18.945848 9272 hybrid_clock.cc:648] HybridClock initialized: now 1786502778945804 us; error 37 us; skew 500 ppm
Aug 12 02:46:18 dist-test-slave-2p8l krb5kdc[6765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502778, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:18.949554 9272 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:46:18.950955 9272 webserver.cc:460] Webserver started at http://127.10.75.66:33095/ using document root <none> and password file <none>
I20260812 02:46:18.951743 9272 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:18.951858 9272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:18.957015 9272 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 02:46:18.959811 9308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:18.961467 9272 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 02:46:18.961735 9272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "2dfb264b589d495b9fcd6d5f6c7b907e"
format_stamp: "Formatted at 2026-08-12 02:45:36 on dist-test-slave-2p8l"
server_key: "5a1f07b709c8c1169cbb6c2e6533ecc0"
server_key_iv: "b18949ca10c150c2e9e854bdfe9d4bd3"
server_key_version: "encryptionkey@0"
I20260812 02:46:18.962756 9272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:18.985193 9272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:18.989691 9272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:18.990026 9272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:18.990899 9272 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:18.992056 9272 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:18.992139 9272 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:18.992224 9272 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:18.992285 9272 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:19.004237 9272 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:45321
I20260812 02:46:19.004261 9510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:45321 every 8 connection(s)
I20260812 02:46:19.005600 9272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:46:19.009111 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 9272
I20260812 02:46:19.009737 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:34315
--local_ip_for_outbound_sockets=127.10.75.67
--tserver_master_addrs=127.10.75.126:35201
--webserver_port=42361
--webserver_interface=127.10.75.67
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:44849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:46:19.011329 9513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:19.008402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:60545)
0812 02:46:19.009131 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:19.009309 (+ 178us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":146,"threads_started":1}
W20260812 02:46:19.011940 9511 heartbeater.cc:644] Failed to heartbeat to 127.10.75.126:35201 (0 consecutive failures): Network error: Failed to ping master at 127.10.75.126:35201: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
I20260812 02:46:19.012744 9513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:19.012454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:37497)
0812 02:46:19.012601 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:19.012673 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260812 02:46:19.013545 9513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:19.013234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:45545)
0812 02:46:19.013383 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:19.013457 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 02:46:19.013787 9511 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 02:46:19.152673 9515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:19.153060 9515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:19.153146 9515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:19.157759 9515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:19.157858 9515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:19.157986 9515 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:46:19.164561 9515 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:44849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:34315
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=42361
--tserver_master_addrs=127.10.75.126:35201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9515
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:19.166247 9515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:19.168437 9515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:19.180080 9520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:19.180191 9526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:19.180449 9515 server_base.cc:1034] running on GCE node
W20260812 02:46:19.180078 9521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:19.180976 9515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:19.181756 9515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:19.182964 9515 hybrid_clock.cc:648] HybridClock initialized: now 1786502779182932 us; error 37 us; skew 500 ppm
Aug 12 02:46:19 dist-test-slave-2p8l krb5kdc[6765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502779, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:19.186378 9515 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:46:19.187259 9515 webserver.cc:460] Webserver started at http://127.10.75.67:42361/ using document root <none> and password file <none>
I20260812 02:46:19.187829 9515 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:19.187891 9515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:19.192324 9515 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 02:46:19.194634 9539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:19.196000 9515 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:46:19.196106 9515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a"
format_stamp: "Formatted at 2026-08-12 02:45:36 on dist-test-slave-2p8l"
server_key: "82c33fe683287bf169b9a7d0e15ee230"
server_key_iv: "0affd5d825688ea8e841766b7962d427"
server_key_version: "encryptionkey@0"
I20260812 02:46:19.196664 9515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:19.214136 9515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:19.217274 9515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:19.217443 9515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:19.218025 9515 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:19.218961 9515 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:19.219020 9515 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:19.219063 9515 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:19.219086 9515 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:19.229373 9515 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:34315
I20260812 02:46:19.229401 9738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:34315 every 8 connection(s)
I20260812 02:46:19.230811 9515 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:46:19.240461 9750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:19.234282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:51293)
0812 02:46:19.238305 (+ 4023us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:19.238485 (+ 180us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3690,"thread_start_us":166,"threads_started":1}
I20260812 02:46:19.241009 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 9515
W20260812 02:46:19.241191 9740 heartbeater.cc:644] Failed to heartbeat to 127.10.75.126:35201 (0 consecutive failures): Network error: Failed to ping master at 127.10.75.126:35201: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
I20260812 02:46:19.241928 9750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:19.241612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:39585)
0812 02:46:19.241761 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:19.241834 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 02:46:19.242873 9756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:19.242444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:37883)
0812 02:46:19.242757 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:19.242803 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":125,"threads_started":1}
W20260812 02:46:19.243142 9740 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 02:46:19.840629 9758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:19.840099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:60811)
0812 02:46:19.840412 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:19.840482 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":87,"threads_started":1}
I20260812 02:46:20.014951 9759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:20.014477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:55413)
0812 02:46:20.014776 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:20.014835 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":89,"threads_started":1}
I20260812 02:46:20.244943 9760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:20.244151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:46795)
0812 02:46:20.244640 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:20.244733 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":138,"threads_started":1}
I20260812 02:46:20.502954 9761 raft_consensus.cc:482] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:46:20.503269 9761 raft_consensus.cc:504] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } }
I20260812 02:46:20.504769 9761 leader_election.cc:288] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2dfb264b589d495b9fcd6d5f6c7b907e (127.10.75.66:45321), 3ab6f7bc8ee640f4b0fe5b635b61bd7a (127.10.75.67:34315)
Aug 12 02:46:20 dist-test-slave-2p8l krb5kdc[6765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502778, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.66@KRBTEST.COM
Aug 12 02:46:20 dist-test-slave-2p8l krb5kdc[6765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502778, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.67@KRBTEST.COM
I20260812 02:46:20.521340 9768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:20.505340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:43449 (local address 127.10.75.66:45321)
0812 02:46:20.505768 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:20.505801 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:20.505857 (+ 56us) server_negotiation.cc:407] Connection header received
0812 02:46:20.506827 (+ 970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:20.506835 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:20.507268 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:20.507641 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:20.509240 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:20.510593 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:20.511936 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:20.512496 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:20.512667 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:20.515928 (+ 3261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:20.515941 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:20.515966 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:20.516015 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:20.518251 (+ 2236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:20.518916 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:20.518921 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:20.518925 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:20.519058 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:20.519490 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:20.519493 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:20.519494 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:20.519986 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:20.520142 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:20.520777 (+ 635us) server_negotiation.cc:299] Negotiation successful
0812 02:46:20.521087 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":177,"threads_started":1}
I20260812 02:46:20.521338 9762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:20.505102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:34315 (local address 127.10.75.65:43941)
0812 02:46:20.505847 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:20.505862 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:20.505975 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:20.507712 (+ 1737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:20.507720 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:20.508412 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:20.509003 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:20.509022 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:20.510593 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:20.510599 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:20.511695 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:20.511706 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:20.512498 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:20.512502 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:20.512673 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:20.513668 (+ 995us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:46:20.513681 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:20.515866 (+ 2185us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:20.518443 (+ 2577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:20.518446 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:20.518448 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:20.518762 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:20.519174 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:20.519177 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:20.519179 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:20.519349 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:20.520125 (+ 776us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:20.520133 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:20.520437 (+ 304us) client_negotiation.cc:769] Sending connection context
0812 02:46:20.520660 (+ 223us) client_negotiation.cc:240] Negotiation successful
0812 02:46:20.521102 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":673,"mutex_wait_us":182,"spinlock_wait_cycles":9216,"thread_start_us":100,"threads_started":1}
I20260812 02:46:20.521353 9769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:20.505348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:43941 (local address 127.10.75.67:34315)
0812 02:46:20.505914 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:20.505926 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:20.505966 (+ 40us) server_negotiation.cc:407] Connection header received
0812 02:46:20.506821 (+ 855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:20.506829 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:20.507268 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:20.507640 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:20.509213 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:20.510428 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:20.511842 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:20.512355 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:20.512549 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:20.516066 (+ 3517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:20.516071 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:20.516082 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:20.516114 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:20.518291 (+ 2177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:20.518899 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:20.518913 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:20.518918 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:20.519056 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:20.519458 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:20.519463 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:20.519468 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:20.519986 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:20.520142 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:20.520773 (+ 631us) server_negotiation.cc:299] Negotiation successful
0812 02:46:20.521086 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":158,"threads_started":1}
I20260812 02:46:20.521391 9764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:20.505103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:45321 (local address 127.10.75.65:43449)
0812 02:46:20.505588 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:20.505606 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:20.505760 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:20.507712 (+ 1952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:20.507720 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:20.508412 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:20.509003 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:20.509022 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:20.510733 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:20.510736 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:20.511694 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:20.511705 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:20.512778 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:20.512784 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:20.512871 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:20.513599 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:46:20.513619 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:20.515625 (+ 2006us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:20.518380 (+ 2755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:20.518390 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:20.518410 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:20.518766 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:20.519180 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:20.519183 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:20.519184 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:20.519361 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:20.520126 (+ 765us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:20.520133 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:20.520437 (+ 304us) client_negotiation.cc:769] Sending connection context
0812 02:46:20.520658 (+ 221us) client_negotiation.cc:240] Negotiation successful
0812 02:46:20.521197 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"mutex_wait_us":353,"spinlock_wait_cycles":43136,"thread_start_us":126,"threads_started":1}
W20260812 02:46:20.525192 9052 leader_election.cc:341] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2dfb264b589d495b9fcd6d5f6c7b907e (127.10.75.66:45321): Not found: Tablet not found: 6f7d174cf16a406d97caccde783418a9
W20260812 02:46:20.525408 9053 leader_election.cc:341] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ab6f7bc8ee640f4b0fe5b635b61bd7a (127.10.75.67:34315): Not found: Tablet not found: 6f7d174cf16a406d97caccde783418a9
I20260812 02:46:20.525478 9052 leader_election.cc:302] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7e97718bd554fbf8fbc0df910f78b95; no voters: 2dfb264b589d495b9fcd6d5f6c7b907e, 3ab6f7bc8ee640f4b0fe5b635b61bd7a
I20260812 02:46:20.525852 9761 raft_consensus.cc:2726] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 02:46:20.842159 9762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:20.841753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:51741)
0812 02:46:20.841903 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:20.841982 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 02:46:21.016819 9771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:21.016159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:54243)
0812 02:46:21.016574 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:21.016650 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":159,"threads_started":1}
I20260812 02:46:21.246384 9773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:21.245847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:33587)
0812 02:46:21.246224 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:21.246284 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":88,"threads_started":1}
I20260812 02:46:21.843488 9776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:21.843044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:48447)
0812 02:46:21.843321 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:21.843379 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":91,"threads_started":1}
I20260812 02:46:22.018455 9779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:22.017878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:59003)
0812 02:46:22.018271 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:22.018349 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":119,"threads_started":1}
I20260812 02:46:22.247754 9781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:22.247246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:39223)
0812 02:46:22.247545 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:22.247607 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":100,"threads_started":1}
I20260812 02:46:22.667490 9783 raft_consensus.cc:482] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:46:22.667737 9783 raft_consensus.cc:504] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } }
I20260812 02:46:22.668340 9783 leader_election.cc:288] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2dfb264b589d495b9fcd6d5f6c7b907e (127.10.75.66:45321), 3ab6f7bc8ee640f4b0fe5b635b61bd7a (127.10.75.67:34315)
W20260812 02:46:22.669488 9053 leader_election.cc:341] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ab6f7bc8ee640f4b0fe5b635b61bd7a (127.10.75.67:34315): Not found: Tablet not found: 6f7d174cf16a406d97caccde783418a9
W20260812 02:46:22.669682 9052 leader_election.cc:341] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2dfb264b589d495b9fcd6d5f6c7b907e (127.10.75.66:45321): Not found: Tablet not found: 6f7d174cf16a406d97caccde783418a9
I20260812 02:46:22.669759 9052 leader_election.cc:302] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7e97718bd554fbf8fbc0df910f78b95; no voters: 2dfb264b589d495b9fcd6d5f6c7b907e, 3ab6f7bc8ee640f4b0fe5b635b61bd7a
I20260812 02:46:22.669931 9783 raft_consensus.cc:2726] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 02:46:22.845300 9785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:22.844603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:60021)
0812 02:46:22.845019 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:22.845101 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":117,"threads_started":1}
I20260812 02:46:23.019964 9786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:23.019393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:53601)
0812 02:46:23.019756 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:23.019833 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":124,"threads_started":1}
I20260812 02:46:23.249449 9787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:23.248838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:54323)
0812 02:46:23.249206 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:23.249296 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":119,"threads_started":1}
I20260812 02:46:23.846932 9789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:23.846431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:53407)
0812 02:46:23.846764 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:23.846824 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":80,"threads_started":1}
I20260812 02:46:24.021430 9790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:24.020925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:59877)
0812 02:46:24.021253 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:24.021319 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":96,"threads_started":1}
I20260812 02:46:24.250923 9792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:24.250452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:50553)
0812 02:46:24.250756 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:24.250818 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":108,"threads_started":1}
I20260812 02:46:24.674326 9794 raft_consensus.cc:482] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:46:24.674528 9794 raft_consensus.cc:504] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } }
I20260812 02:46:24.675169 9794 leader_election.cc:288] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2dfb264b589d495b9fcd6d5f6c7b907e (127.10.75.66:45321), 3ab6f7bc8ee640f4b0fe5b635b61bd7a (127.10.75.67:34315)
W20260812 02:46:24.676374 9053 leader_election.cc:341] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ab6f7bc8ee640f4b0fe5b635b61bd7a (127.10.75.67:34315): Not found: Tablet not found: 6f7d174cf16a406d97caccde783418a9
W20260812 02:46:24.676560 9052 leader_election.cc:341] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2dfb264b589d495b9fcd6d5f6c7b907e (127.10.75.66:45321): Not found: Tablet not found: 6f7d174cf16a406d97caccde783418a9
I20260812 02:46:24.676647 9052 leader_election.cc:302] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7e97718bd554fbf8fbc0df910f78b95; no voters: 2dfb264b589d495b9fcd6d5f6c7b907e, 3ab6f7bc8ee640f4b0fe5b635b61bd7a
I20260812 02:46:24.676872 9794 raft_consensus.cc:2726] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 02:46:24.848682 9795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:24.848019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:59985)
0812 02:46:24.848411 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:24.848492 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":174,"threads_started":1}
I20260812 02:46:25.023156 9797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:25.022565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:50663)
0812 02:46:25.022929 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:25.023014 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":104,"threads_started":1}
I20260812 02:46:25.252665 9798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:25.252041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:46083)
0812 02:46:25.252444 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:25.252528 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":139,"threads_started":1}
I20260812 02:46:25.850346 9799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:25.849699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:55273)
0812 02:46:25.850123 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:25.850209 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":117,"threads_started":1}
I20260812 02:46:26.025031 9800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:26.024329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:51939)
0812 02:46:26.024798 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:26.024880 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":118,"threads_started":1}
I20260812 02:46:26.254662 9801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:26.253852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:46455)
0812 02:46:26.254452 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:26.254530 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":315,"threads_started":1}
I20260812 02:46:26.852129 9802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:26.851462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:40097)
0812 02:46:26.851845 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:26.851946 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":104,"threads_started":1}
I20260812 02:46:27.026428 9803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:27.025916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:41221)
0812 02:46:27.026266 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:27.026326 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":82,"threads_started":1}
I20260812 02:46:27.256201 9804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:27.255675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:38157)
0812 02:46:27.256014 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:27.256094 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":115,"threads_started":1}
I20260812 02:46:27.319360 9809 raft_consensus.cc:482] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:46:27.319552 9809 raft_consensus.cc:504] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } }
I20260812 02:46:27.320071 9809 leader_election.cc:288] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2dfb264b589d495b9fcd6d5f6c7b907e (127.10.75.66:45321), 3ab6f7bc8ee640f4b0fe5b635b61bd7a (127.10.75.67:34315)
W20260812 02:46:27.320876 9052 leader_election.cc:341] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2dfb264b589d495b9fcd6d5f6c7b907e (127.10.75.66:45321): Not found: Tablet not found: 6f7d174cf16a406d97caccde783418a9
W20260812 02:46:27.320988 9053 leader_election.cc:341] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ab6f7bc8ee640f4b0fe5b635b61bd7a (127.10.75.67:34315): Not found: Tablet not found: 6f7d174cf16a406d97caccde783418a9
I20260812 02:46:27.321120 9053 leader_election.cc:302] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7e97718bd554fbf8fbc0df910f78b95; no voters: 2dfb264b589d495b9fcd6d5f6c7b907e, 3ab6f7bc8ee640f4b0fe5b635b61bd7a
I20260812 02:46:27.321305 9809 raft_consensus.cc:2726] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 02:46:27.853765 9811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:27.853149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:49577)
0812 02:46:27.853515 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:27.853584 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":115,"threads_started":1}
I20260812 02:46:28.028177 9812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:28.027550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:57185)
0812 02:46:28.027949 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:28.028033 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":144,"threads_started":1}
I20260812 02:46:28.257854 9813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:28.257241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:41945)
0812 02:46:28.257606 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:28.257685 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":110,"threads_started":1}
I20260812 02:46:28.855557 9815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:28.855058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:39505)
0812 02:46:28.855382 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:28.855443 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":105,"threads_started":1}
I20260812 02:46:29.029696 9818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:29.029231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:44585)
0812 02:46:29.029519 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:29.029588 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":81,"threads_started":1}
I20260812 02:46:29.259243 9822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:29.258759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:38519)
0812 02:46:29.259068 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:29.259131 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":84,"threads_started":1}
I20260812 02:46:29.857270 9823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:29.856658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:41481)
0812 02:46:29.857051 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:29.857132 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":110,"threads_started":1}
I20260812 02:46:30.031255 9824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:30.030667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:35947)
0812 02:46:30.031047 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:30.031120 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":105,"threads_started":1}
I20260812 02:46:30.260864 9825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:30.260257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:35799)
0812 02:46:30.260636 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:30.260725 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":109,"threads_started":1}
I20260812 02:46:30.858853 9827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:30.858312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:59617)
0812 02:46:30.858682 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:30.858747 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":93,"threads_started":1}
I20260812 02:46:30.863462 9830 raft_consensus.cc:482] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:46:30.863588 9830 raft_consensus.cc:504] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfb264b589d495b9fcd6d5f6c7b907e" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 45321 } } peers { permanent_uuid: "3ab6f7bc8ee640f4b0fe5b635b61bd7a" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 34315 } } peers { permanent_uuid: "c7e97718bd554fbf8fbc0df910f78b95" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42303 } }
I20260812 02:46:30.863986 9830 leader_election.cc:288] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2dfb264b589d495b9fcd6d5f6c7b907e (127.10.75.66:45321), 3ab6f7bc8ee640f4b0fe5b635b61bd7a (127.10.75.67:34315)
W20260812 02:46:30.864943 9052 leader_election.cc:341] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2dfb264b589d495b9fcd6d5f6c7b907e (127.10.75.66:45321): Not found: Tablet not found: 6f7d174cf16a406d97caccde783418a9
W20260812 02:46:30.865068 9053 leader_election.cc:341] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ab6f7bc8ee640f4b0fe5b635b61bd7a (127.10.75.67:34315): Not found: Tablet not found: 6f7d174cf16a406d97caccde783418a9
I20260812 02:46:30.865195 9053 leader_election.cc:302] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7e97718bd554fbf8fbc0df910f78b95; no voters: 2dfb264b589d495b9fcd6d5f6c7b907e, 3ab6f7bc8ee640f4b0fe5b635b61bd7a
I20260812 02:46:30.865394 9830 raft_consensus.cc:2726] T 6f7d174cf16a406d97caccde783418a9 P c7e97718bd554fbf8fbc0df910f78b95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 02:46:31.032780 9831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:31.032287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:56013)
0812 02:46:31.032615 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:31.032676 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":106,"threads_started":1}
I20260812 02:46:31.262472 9832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:31.261935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:50231)
0812 02:46:31.262284 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:31.262346 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":133,"threads_started":1}
I20260812 02:46:31.860651 9833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:31.860008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:44833)
0812 02:46:31.860447 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:31.860515 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":145,"threads_started":1}
I20260812 02:46:32.034502 9834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:32.033818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:38417)
0812 02:46:32.034274 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:32.034354 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":110,"threads_started":1}
I20260812 02:46:32.264219 9835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:32.263627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:47999)
0812 02:46:32.263999 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:32.264081 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":111,"threads_started":1}
I20260812 02:46:32.862743 9841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:32.862038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:53163)
0812 02:46:32.862522 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:32.862604 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":114,"threads_started":1}
I20260812 02:46:33.036289 9842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:33.035597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:53333)
0812 02:46:33.036081 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:33.036152 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":166,"threads_started":1}
I20260812 02:46:33.266079 9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:33.265408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:33545)
0812 02:46:33.265811 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:33.265898 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":117,"threads_started":1}
I20260812 02:46:33.864609 9844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:33.864045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.65:59373)
0812 02:46:33.864391 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:33.864457 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":104,"threads_started":1}
I20260812 02:46:34.038225 9846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:34.037560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.66:58237)
0812 02:46:34.037917 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:34.038000 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":106,"threads_started":1}
I20260812 02:46:34.247218 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 8940
I20260812 02:46:34.268076 9847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:34.267461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:35201 (local address 127.10.75.67:46547)
0812 02:46:34.267853 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:34.267936 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.126:35201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":109,"threads_started":1}
I20260812 02:46:34.272136 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 9272
I20260812 02:46:34.299677 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 9515
2026-08-12T02:46:34Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (60368 ms)
[----------] 30 tests from SecurityITest (254602 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:46:34 dist-test-slave-2p8l krb5kdc[9851](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:46:34 dist-test-slave-2p8l krb5kdc[9851](info): set up 2 sockets
Aug 12 02:46:34 dist-test-slave-2p8l krb5kdc[9851](info): commencing operation
krb5kdc: starting...
W20260812 02:46:35.662376 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.314s user 0.002s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:46:35 dist-test-slave-2p8l krb5kdc[9851](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:46:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:46:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:46:35.793936 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:44423
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:34015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:44423
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:35.920992 9879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:35.921240 9879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:35.921280 9879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:35.925303 9879 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:46:35.925357 9879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:35.925377 9879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:35.925393 9879 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:46:35.925410 9879 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:46:35.930610 9879 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:34015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:44423
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:44423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:35.931594 9879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:35.932561 9879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:35.941072 9888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:35.941195 9879 server_base.cc:1034] running on GCE node
W20260812 02:46:35.941144 9891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:35.941063 9889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:35.941911 9879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:35.942973 9879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:35.944147 9879 hybrid_clock.cc:648] HybridClock initialized: now 1786502795944121 us; error 39 us; skew 500 ppm
Aug 12 02:46:35 dist-test-slave-2p8l krb5kdc[9851](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502795, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:35.951798 9879 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:46:35.952731 9879 webserver.cc:460] Webserver started at http://127.10.75.126:35113/ using document root <none> and password file <none>
I20260812 02:46:35.953254 9879 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:35.953315 9879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:35.953476 9879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:35.955526 9879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "bbaefd3d3e0a4f75aff4a0d00991318f"
format_stamp: "Formatted at 2026-08-12 02:46:35 on dist-test-slave-2p8l"
server_key: "eb35c4e4761f01d811475cb07ddab9e8"
server_key_iv: "f0fc17f3be85787d81a54bfeef9aad2b"
server_key_version: "encryptionkey@0"
I20260812 02:46:35.956054 9879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "bbaefd3d3e0a4f75aff4a0d00991318f"
format_stamp: "Formatted at 2026-08-12 02:46:35 on dist-test-slave-2p8l"
server_key: "eb35c4e4761f01d811475cb07ddab9e8"
server_key_iv: "f0fc17f3be85787d81a54bfeef9aad2b"
server_key_version: "encryptionkey@0"
I20260812 02:46:35.959803 9879 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 02:46:35.962334 9901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:35.963663 9879 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:46:35.963838 9879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "bbaefd3d3e0a4f75aff4a0d00991318f"
format_stamp: "Formatted at 2026-08-12 02:46:35 on dist-test-slave-2p8l"
server_key: "eb35c4e4761f01d811475cb07ddab9e8"
server_key_iv: "f0fc17f3be85787d81a54bfeef9aad2b"
server_key_version: "encryptionkey@0"
I20260812 02:46:35.963967 9879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:35.978736 9879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:35.981801 9879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:35.982007 9879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:35.989341 9879 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:44423
I20260812 02:46:35.989368 9999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:44423 every 8 connection(s)
I20260812 02:46:35.990298 9879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:46:35.990947 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 9879
I20260812 02:46:35.991104 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:46:35.991396 10541 external_mini_cluster.cc:1428] Setting key c11feece5c352bf23b6d769a57f093c2
I20260812 02:46:35.993579 10000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:35.999262 10000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f: Bootstrap starting.
Aug 12 02:46:35 dist-test-slave-2p8l krb5kdc[9851](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:46:36.001896 10000 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:36.002729 10000 log.cc:824] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:36.004668 10000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f: No bootstrap required, opened a new log
I20260812 02:46:36.005491 10007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:35.992851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44068 (local address 127.10.75.126:44423)
0812 02:46:35.993316 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:35.993331 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:35.993365 (+ 34us) server_negotiation.cc:407] Connection header received
0812 02:46:35.994113 (+ 748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:35.994143 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:35.994470 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:35.994806 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:35.995617 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:35.996606 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:35.997484 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:35.997952 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:35.998162 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:36.000735 (+ 2573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:36.000741 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:36.000753 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:36.000780 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:36.002604 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:36.003102 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:36.003109 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:36.003116 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:36.003234 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:36.003529 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:36.003533 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:36.003535 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:36.003918 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:36.004119 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:36.004424 (+ 305us) server_negotiation.cc:299] Negotiation successful
0812 02:46:36.004782 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":171,"threads_started":1}
I20260812 02:46:36.008762 10000 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbaefd3d3e0a4f75aff4a0d00991318f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44423 } }
I20260812 02:46:36.009009 10000 raft_consensus.cc:374] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:36.009104 10000 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbaefd3d3e0a4f75aff4a0d00991318f, State: Initialized, Role: FOLLOWER
I20260812 02:46:36.009537 10000 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbaefd3d3e0a4f75aff4a0d00991318f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44423 } }
I20260812 02:46:36.009698 10000 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:46:36.009796 10000 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:46:36.009920 10000 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:36.010913 10000 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbaefd3d3e0a4f75aff4a0d00991318f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44423 } }
I20260812 02:46:36.011272 10000 leader_election.cc:302] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbaefd3d3e0a4f75aff4a0d00991318f; no voters:
I20260812 02:46:36.011588 10000 leader_election.cc:288] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:46:36.011730 10015 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:36.012007 10015 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f [term 1 LEADER]: Becoming Leader. State: Replica: bbaefd3d3e0a4f75aff4a0d00991318f, State: Running, Role: LEADER
I20260812 02:46:36.012363 10015 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbaefd3d3e0a4f75aff4a0d00991318f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44423 } }
I20260812 02:46:36.012848 10000 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:46:36.014030 10018 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbaefd3d3e0a4f75aff4a0d00991318f. Latest consensus state: current_term: 1 leader_uuid: "bbaefd3d3e0a4f75aff4a0d00991318f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbaefd3d3e0a4f75aff4a0d00991318f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44423 } } }
I20260812 02:46:36.014205 10018 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:36.014537 10016 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bbaefd3d3e0a4f75aff4a0d00991318f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbaefd3d3e0a4f75aff4a0d00991318f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44423 } } }
I20260812 02:46:36.014652 10030 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:46:36.014695 10016 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:36.018183 10030 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:46:36.023656 10030 catalog_manager.cc:1347] Generated new cluster ID: 83fd7739ebcc45afaff82270fea4d07c
I20260812 02:46:36.023728 10030 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:46:36.041129 10030 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:46:36.042448 10030 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:46:36.053200 10030 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f: Generated new TSK 0
I20260812 02:46:36.053885 10030 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
I20260812 02:46:36.089599 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:44423
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:34015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:36.205338 10052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:36.205696 10052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:36.205802 10052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:36.210490 10052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:36.210546 10052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:36.210602 10052 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:46:36.216013 10052 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:34015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:44423
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10052
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:36.217325 10052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:36.218403 10052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:36.228147 10071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:36.228137 10065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:36.228114 10060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:36.228328 10052 server_base.cc:1034] running on GCE node
I20260812 02:46:36.228793 10052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:36.229439 10052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:36.230631 10052 hybrid_clock.cc:648] HybridClock initialized: now 1786502796230607 us; error 51 us; skew 500 ppm
Aug 12 02:46:36 dist-test-slave-2p8l krb5kdc[9851](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502796, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:36.233405 10052 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:46:36.234366 10052 webserver.cc:460] Webserver started at http://127.10.75.65:39731/ using document root <none> and password file <none>
I20260812 02:46:36.234911 10052 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:36.234975 10052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:36.235193 10052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:36.237210 10052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "26c8288964a24a3fb60c37bf6a300a81"
format_stamp: "Formatted at 2026-08-12 02:46:36 on dist-test-slave-2p8l"
server_key: "f9e6e8a96d6ca0b5243f0f4edb71656f"
server_key_iv: "03d535fa0a3febc2b685095039b32eb1"
server_key_version: "encryptionkey@0"
I20260812 02:46:36.237768 10052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "26c8288964a24a3fb60c37bf6a300a81"
format_stamp: "Formatted at 2026-08-12 02:46:36 on dist-test-slave-2p8l"
server_key: "f9e6e8a96d6ca0b5243f0f4edb71656f"
server_key_iv: "03d535fa0a3febc2b685095039b32eb1"
server_key_version: "encryptionkey@0"
I20260812 02:46:36.241372 10052 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260812 02:46:36.243773 10078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:36.244896 10052 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:46:36.245019 10052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "26c8288964a24a3fb60c37bf6a300a81"
format_stamp: "Formatted at 2026-08-12 02:46:36 on dist-test-slave-2p8l"
server_key: "f9e6e8a96d6ca0b5243f0f4edb71656f"
server_key_iv: "03d535fa0a3febc2b685095039b32eb1"
server_key_version: "encryptionkey@0"
I20260812 02:46:36.245137 10052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:36.263273 10052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:36.266243 10052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:36.266434 10052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:36.267050 10052 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:36.267855 10052 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:36.267902 10052 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:36.267970 10052 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:36.268002 10052 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:36.276855 10052 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:41481
I20260812 02:46:36.276897 10308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:41481 every 8 connection(s)
I20260812 02:46:36.277721 10052 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:46:36.286666 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 10052
I20260812 02:46:36.286842 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
Aug 12 02:46:36 dist-test-slave-2p8l krb5kdc[9851](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502796, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:46:36.287199 10541 external_mini_cluster.cc:1428] Setting key d3ccc28347468a9f0e152564f15b4f45
I20260812 02:46:36.292296 10007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:36.279552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:42977 (local address 127.10.75.126:44423)
0812 02:46:36.279729 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:36.279734 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:36.280502 (+ 768us) server_negotiation.cc:407] Connection header received
0812 02:46:36.281801 (+ 1299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:36.281804 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:36.281853 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:36.281931 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:36.283104 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.283671 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.284850 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.285105 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.285196 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:36.287811 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:36.287815 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:36.287817 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:36.287843 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:36.289429 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:36.290409 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:36.290412 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:36.290413 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:36.290494 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:36.290978 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:36.290982 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:36.290983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:36.291285 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:36.291413 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:36.291936 (+ 523us) server_negotiation.cc:299] Negotiation successful
0812 02:46:36.292087 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 02:46:36.293089 10313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:36.279910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:44423 (local address 127.10.75.65:42977)
0812 02:46:36.280346 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:36.280388 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:36.281583 (+ 1195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:36.282131 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:36.282137 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:36.282484 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:36.282934 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:36.282947 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.283797 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.283801 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:36.284713 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:36.284722 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.285245 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.285248 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:36.285391 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:36.285922 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:46:36.285938 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:36.287639 (+ 1701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:36.289562 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:36.289571 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:36.289588 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:36.289993 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:36.290639 (+ 646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:36.290646 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:36.290651 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:36.290852 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:36.291433 (+ 581us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:36.291438 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:36.291678 (+ 240us) client_negotiation.cc:769] Sending connection context
0812 02:46:36.291855 (+ 177us) client_negotiation.cc:240] Negotiation successful
0812 02:46:36.292114 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":124,"threads_started":1}
I20260812 02:46:36.294600 10310 heartbeater.cc:347] Connected to a master server at 127.10.75.126:44423
I20260812 02:46:36.294878 10310 heartbeater.cc:464] Registering TS with master...
I20260812 02:46:36.295387 10310 heartbeater.cc:511] Master 127.10.75.126:44423 requested a full tablet report, sending...
I20260812 02:46:36.296972 9935 ts_manager.cc:194] Registered new tserver with Master: 26c8288964a24a3fb60c37bf6a300a81 (127.10.75.65:41481)
WARNING: no policy specified for kudu/127.10.75.66@KRBTEST.COM; defaulting to no policy
I20260812 02:46:36.298282 9935 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:42977
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
I20260812 02:46:36.318259 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:44423
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:34015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:36.429699 10319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:36.429970 10319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:36.430047 10319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:36.434038 10319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:36.434178 10319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:36.434294 10319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:46:36.439436 10319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:34015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:44423
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:36.440363 10319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:36.441288 10319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 02:46:36.451212 10319 server_base.cc:1034] running on GCE node
W20260812 02:46:36.451154 10331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:36.451175 10335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:36.451176 10326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:36.451826 10319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:36.452435 10319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:36.453617 10319 hybrid_clock.cc:648] HybridClock initialized: now 1786502796453596 us; error 33 us; skew 500 ppm
Aug 12 02:46:36 dist-test-slave-2p8l krb5kdc[9851](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502796, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:36.456547 10319 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:46:36.457378 10319 webserver.cc:460] Webserver started at http://127.10.75.66:39657/ using document root <none> and password file <none>
I20260812 02:46:36.457964 10319 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:36.458029 10319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:36.458261 10319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:36.460232 10319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "fd42726726f54953aca50426cbf14496"
format_stamp: "Formatted at 2026-08-12 02:46:36 on dist-test-slave-2p8l"
server_key: "c6a5be046ce70ef62ae8eb4fbfee9f79"
server_key_iv: "0bad15ddc4917f7d6df17103d11d3ea0"
server_key_version: "encryptionkey@0"
I20260812 02:46:36.460805 10319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "fd42726726f54953aca50426cbf14496"
format_stamp: "Formatted at 2026-08-12 02:46:36 on dist-test-slave-2p8l"
server_key: "c6a5be046ce70ef62ae8eb4fbfee9f79"
server_key_iv: "0bad15ddc4917f7d6df17103d11d3ea0"
server_key_version: "encryptionkey@0"
I20260812 02:46:36.464594 10319 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 02:46:36.467015 10345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:36.468357 10319 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:46:36.468504 10319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "fd42726726f54953aca50426cbf14496"
format_stamp: "Formatted at 2026-08-12 02:46:36 on dist-test-slave-2p8l"
server_key: "c6a5be046ce70ef62ae8eb4fbfee9f79"
server_key_iv: "0bad15ddc4917f7d6df17103d11d3ea0"
server_key_version: "encryptionkey@0"
I20260812 02:46:36.468619 10319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:36.477499 10319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:36.480358 10319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:36.480554 10319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:36.481149 10319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:36.481940 10319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:36.482012 10319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:36.482111 10319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:36.482177 10319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:36.491365 10319 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:46607
I20260812 02:46:36.491386 10574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:46607 every 8 connection(s)
I20260812 02:46:36.492228 10319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:46:36.495368 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 10319
I20260812 02:46:36.495477 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:46:36.495786 10541 external_mini_cluster.cc:1428] Setting key ec8f942e46cd24dc00c2c16595c4b553
Aug 12 02:46:36 dist-test-slave-2p8l krb5kdc[9851](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502796, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:46:36.506292 10007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:36.494172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:33935 (local address 127.10.75.126:44423)
0812 02:46:36.494314 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:36.494317 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:36.495003 (+ 686us) server_negotiation.cc:407] Connection header received
0812 02:46:36.496492 (+ 1489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:36.496496 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:36.496580 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:36.496672 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:36.497937 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.498553 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.499720 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.499949 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.500066 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:36.502506 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:36.502514 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:36.502517 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:36.502541 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:36.504132 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:36.504709 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:36.504713 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:36.504715 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:36.504799 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:36.505151 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:36.505156 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:36.505158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:36.505338 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:36.505446 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:36.505956 (+ 510us) server_negotiation.cc:299] Negotiation successful
0812 02:46:36.506120 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
WARNING: no policy specified for kudu/127.10.75.67@KRBTEST.COM; defaulting to no policy
I20260812 02:46:36.507048 10579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:36.494412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:44423 (local address 127.10.75.66:33935)
0812 02:46:36.494849 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:36.494890 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:36.496254 (+ 1364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:36.496869 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:36.496876 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:36.497328 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:36.497788 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:36.497802 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.498692 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.498698 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:36.499566 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:36.499576 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.500105 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.500109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:36.500282 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:36.500823 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:46:36.500839 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:36.502336 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:36.504267 (+ 1931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:36.504273 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:36.504287 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:36.504563 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:36.504899 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:36.504902 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:36.504904 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:36.505047 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:36.505461 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:36.505468 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:36.505708 (+ 240us) client_negotiation.cc:769] Sending connection context
0812 02:46:36.505910 (+ 202us) client_negotiation.cc:240] Negotiation successful
0812 02:46:36.506244 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":127,"threads_started":1}
I20260812 02:46:36.508203 10575 heartbeater.cc:347] Connected to a master server at 127.10.75.126:44423
I20260812 02:46:36.508416 10575 heartbeater.cc:464] Registering TS with master...
I20260812 02:46:36.508873 10575 heartbeater.cc:511] Master 127.10.75.126:44423 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.67@KRBTEST.COM" created.
I20260812 02:46:36.509912 9935 ts_manager.cc:194] Registered new tserver with Master: fd42726726f54953aca50426cbf14496 (127.10.75.66:46607)
I20260812 02:46:36.510535 9935 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:33935
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
I20260812 02:46:36.527262 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:44423
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:34015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:36.637809 10583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:36.638046 10583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:36.638154 10583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:36.642009 10583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:36.642072 10583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:36.642179 10583 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:46:36.647236 10583 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:34015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:44423
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:36.648129 10583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:36.649104 10583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:36.658281 10588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:36.658386 10589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:36.658274 10599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:36.658552 10583 server_base.cc:1034] running on GCE node
I20260812 02:46:36.659013 10583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:36.659682 10583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:36.660873 10583 hybrid_clock.cc:648] HybridClock initialized: now 1786502796660859 us; error 28 us; skew 500 ppm
Aug 12 02:46:36 dist-test-slave-2p8l krb5kdc[9851](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502796, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:36.663693 10583 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:46:36.664564 10583 webserver.cc:460] Webserver started at http://127.10.75.67:43143/ using document root <none> and password file <none>
I20260812 02:46:36.665107 10583 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:36.665198 10583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:36.665387 10583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:36.667479 10583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "9a0d6a444b7f492ca8c890ed7ee45675"
format_stamp: "Formatted at 2026-08-12 02:46:36 on dist-test-slave-2p8l"
server_key: "d5d1e950a80b64a3f74296a27490656c"
server_key_iv: "6b8bb702712640580ae323db2493cda8"
server_key_version: "encryptionkey@0"
I20260812 02:46:36.668049 10583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "9a0d6a444b7f492ca8c890ed7ee45675"
format_stamp: "Formatted at 2026-08-12 02:46:36 on dist-test-slave-2p8l"
server_key: "d5d1e950a80b64a3f74296a27490656c"
server_key_iv: "6b8bb702712640580ae323db2493cda8"
server_key_version: "encryptionkey@0"
I20260812 02:46:36.671798 10583 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260812 02:46:36.674331 10610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:36.675725 10583 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 02:46:36.675902 10583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "9a0d6a444b7f492ca8c890ed7ee45675"
format_stamp: "Formatted at 2026-08-12 02:46:36 on dist-test-slave-2p8l"
server_key: "d5d1e950a80b64a3f74296a27490656c"
server_key_iv: "6b8bb702712640580ae323db2493cda8"
server_key_version: "encryptionkey@0"
I20260812 02:46:36.676030 10583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:36.701130 10583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:36.704859 10583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:36.705102 10583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:36.705770 10583 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:36.706686 10583 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:36.706768 10583 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:36.706848 10583 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:36.706897 10583 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:36.716956 10583 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:44083
I20260812 02:46:36.716980 10813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:44083 every 8 connection(s)
I20260812 02:46:36.717890 10583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:46:36.724099 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 10583
I20260812 02:46:36.724259 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:46:36.724591 10541 external_mini_cluster.cc:1428] Setting key fffbc37a82214e89dd68bc885eba4f46
Aug 12 02:46:36 dist-test-slave-2p8l krb5kdc[9851](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502796, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:46:36.731983 10007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:36.719726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:58773 (local address 127.10.75.126:44423)
0812 02:46:36.719909 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:36.719914 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:36.720796 (+ 882us) server_negotiation.cc:407] Connection header received
0812 02:46:36.722237 (+ 1441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:36.722241 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:36.722293 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:36.722378 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:36.723490 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.724084 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.725643 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.725877 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.725966 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:36.728512 (+ 2546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:36.728515 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:36.728517 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:36.728543 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:36.730195 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:36.730647 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:36.730650 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:36.730651 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:36.730732 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:36.731025 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:36.731028 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:36.731029 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:36.731221 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:36.731305 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:36.731755 (+ 450us) server_negotiation.cc:299] Negotiation successful
0812 02:46:36.731859 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 02:46:36.732721 10818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:36.720183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:44423 (local address 127.10.75.67:58773)
0812 02:46:36.720639 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:36.720680 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:36.721968 (+ 1288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:36.722526 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:36.722533 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:36.722897 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:36.723351 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:36.723364 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.724225 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.724229 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:36.725524 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:36.725536 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.726023 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.726028 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:36.726243 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:36.726920 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:46:36.726942 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:36.728359 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:36.730301 (+ 1942us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:36.730306 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:36.730316 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:36.730545 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:36.730817 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:36.730819 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:36.730820 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:36.730941 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:36.731314 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:36.731319 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:36.731521 (+ 202us) client_negotiation.cc:769] Sending connection context
0812 02:46:36.731696 (+ 175us) client_negotiation.cc:240] Negotiation successful
0812 02:46:36.731926 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":131,"threads_started":1}
I20260812 02:46:36.733810 10814 heartbeater.cc:347] Connected to a master server at 127.10.75.126:44423
I20260812 02:46:36.734131 10814 heartbeater.cc:464] Registering TS with master...
I20260812 02:46:36.734740 10814 heartbeater.cc:511] Master 127.10.75.126:44423 requested a full tablet report, sending...
I20260812 02:46:36.735833 9935 ts_manager.cc:194] Registered new tserver with Master: 9a0d6a444b7f492ca8c890ed7ee45675 (127.10.75.67:44083)
I20260812 02:46:36.736423 9935 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:58773
I20260812 02:46:36.738763 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:46:36.748160 10007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:36.740784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36032 (local address 127.10.75.126:44423)
0812 02:46:36.740922 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:36.740927 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:36.741044 (+ 117us) server_negotiation.cc:407] Connection header received
0812 02:46:36.741136 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:36.741138 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:36.741175 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:36.741239 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:36.741855 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.742574 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.743434 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.743667 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.743781 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:36.745118 (+ 1337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:36.745122 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:36.745125 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:36.745149 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:36.746503 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:36.746929 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:36.746933 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:36.746934 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:36.747014 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:36.747294 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:36.747299 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:36.747301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:36.747507 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:36.747660 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:36.747889 (+ 229us) server_negotiation.cc:299] Negotiation successful
0812 02:46:36.748000 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 02:46:36.750963 9935 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36032:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:46:36.753891 9935 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:46:36.767628 10838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:36.761954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:41481 (local address 127.0.0.1:60146)
0812 02:46:36.762467 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:36.762517 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:36.762653 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:36.763241 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:36.763247 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:36.763276 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:36.763418 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:36.763424 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.764828 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.764833 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:36.765768 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:36.765781 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.766967 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.766973 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:36.767086 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:36.767135 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 02:46:36.767299 (+ 164us) client_negotiation.cc:240] Negotiation successful
0812 02:46:36.767478 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"mutex_wait_us":41,"thread_start_us":93,"threads_started":1}
I20260812 02:46:36.768052 10839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:36.762150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60146 (local address 127.10.75.65:41481)
0812 02:46:36.762711 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:36.762728 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:36.762758 (+ 30us) server_negotiation.cc:407] Connection header received
0812 02:46:36.762845 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:36.762850 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:36.763061 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:36.763258 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:36.763606 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.764703 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.765908 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.766791 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.767003 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:36.767158 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:36.767799 (+ 641us) server_negotiation.cc:299] Negotiation successful
0812 02:46:36.767910 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":108,"threads_started":1}
I20260812 02:46:36.769160 10844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:36.762698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:46607 (local address 127.0.0.1:60904)
0812 02:46:36.762945 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:36.762959 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:36.763065 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:36.764171 (+ 1106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:36.764177 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:36.764202 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:36.764317 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:36.764323 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.765992 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.765996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:36.767336 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:36.767347 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.768727 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.768731 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:36.768839 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:36.768867 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 02:46:36.768952 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 02:46:36.769020 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":102,"threads_started":1}
I20260812 02:46:36.769222 10842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:36.762326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60904 (local address 127.10.75.66:46607)
0812 02:46:36.763728 (+ 1402us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:36.763740 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:36.763762 (+ 22us) server_negotiation.cc:407] Connection header received
0812 02:46:36.763834 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:36.763839 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:36.764005 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:36.764153 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:36.764463 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.765794 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.767469 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.768600 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.768718 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:36.768860 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:36.768979 (+ 119us) server_negotiation.cc:299] Negotiation successful
0812 02:46:36.769073 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1298,"thread_start_us":146,"threads_started":1}
I20260812 02:46:36.770197 10845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:36.762746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:44083 (local address 127.0.0.1:42596)
0812 02:46:36.763584 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:36.763596 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:36.763673 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:36.764336 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:36.764339 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:36.764358 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:36.764444 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:36.764449 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.767289 (+ 2840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.767294 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:36.768488 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:36.768499 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.769801 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.769805 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:36.769890 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:36.769912 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 02:46:36.769976 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 02:46:36.770038 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":768,"thread_start_us":104,"threads_started":1}
I20260812 02:46:36.770661 10846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:36.763196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42596 (local address 127.10.75.67:44083)
0812 02:46:36.763866 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:36.763874 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:36.763892 (+ 18us) server_negotiation.cc:407] Connection header received
0812 02:46:36.763946 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:36.763949 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:36.764082 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:36.764250 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:36.764571 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.767152 (+ 2581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.768663 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.769537 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.769649 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:36.770361 (+ 712us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:36.770413 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 02:46:36.770497 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":99,"threads_started":1}
I20260812 02:46:36.771489 10173 tablet_service.cc:1467] Processing CreateTablet for tablet c2bac4bf295d4ff5a462d505d76f5f27 (DEFAULT_TABLE table=test-table [id=0cc719ac118c46248ee004eab6bc9106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:46:36.771983 10427 tablet_service.cc:1467] Processing CreateTablet for tablet c2bac4bf295d4ff5a462d505d76f5f27 (DEFAULT_TABLE table=test-table [id=0cc719ac118c46248ee004eab6bc9106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:46:36.772672 10173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2bac4bf295d4ff5a462d505d76f5f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:36.772992 10427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2bac4bf295d4ff5a462d505d76f5f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:36.773898 10700 tablet_service.cc:1467] Processing CreateTablet for tablet c2bac4bf295d4ff5a462d505d76f5f27 (DEFAULT_TABLE table=test-table [id=0cc719ac118c46248ee004eab6bc9106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:46:36.775141 10700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2bac4bf295d4ff5a462d505d76f5f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:36.779948 10848 tablet_bootstrap.cc:492] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81: Bootstrap starting.
I20260812 02:46:36.782089 10852 tablet_bootstrap.cc:492] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675: Bootstrap starting.
I20260812 02:46:36.782121 10848 tablet_bootstrap.cc:654] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:36.782459 10850 tablet_bootstrap.cc:492] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496: Bootstrap starting.
I20260812 02:46:36.783521 10848 log.cc:824] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:36.784529 10852 tablet_bootstrap.cc:654] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:36.785069 10850 tablet_bootstrap.cc:654] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:36.785398 10852 log.cc:824] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:36.785948 10850 log.cc:824] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:36.786000 10848 tablet_bootstrap.cc:492] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81: No bootstrap required, opened a new log
I20260812 02:46:36.786216 10848 ts_tablet_manager.cc:1397] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260812 02:46:36.787164 10852 tablet_bootstrap.cc:492] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675: No bootstrap required, opened a new log
I20260812 02:46:36.787367 10852 ts_tablet_manager.cc:1397] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 02:46:36.787843 10850 tablet_bootstrap.cc:492] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496: No bootstrap required, opened a new log
I20260812 02:46:36.788023 10850 ts_tablet_manager.cc:1397] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 02:46:36.790257 10852 raft_consensus.cc:348] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c8288964a24a3fb60c37bf6a300a81" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41481 } } peers { permanent_uuid: "fd42726726f54953aca50426cbf14496" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46607 } } peers { permanent_uuid: "9a0d6a444b7f492ca8c890ed7ee45675" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44083 } }
I20260812 02:46:36.790234 10848 raft_consensus.cc:348] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c8288964a24a3fb60c37bf6a300a81" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41481 } } peers { permanent_uuid: "fd42726726f54953aca50426cbf14496" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46607 } } peers { permanent_uuid: "9a0d6a444b7f492ca8c890ed7ee45675" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44083 } }
I20260812 02:46:36.790508 10848 raft_consensus.cc:374] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:36.790508 10852 raft_consensus.cc:374] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:36.790567 10852 raft_consensus.cc:729] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a0d6a444b7f492ca8c890ed7ee45675, State: Initialized, Role: FOLLOWER
I20260812 02:46:36.790618 10848 raft_consensus.cc:729] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26c8288964a24a3fb60c37bf6a300a81, State: Initialized, Role: FOLLOWER
I20260812 02:46:36.791086 10852 consensus_queue.cc:260] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c8288964a24a3fb60c37bf6a300a81" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41481 } } peers { permanent_uuid: "fd42726726f54953aca50426cbf14496" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46607 } } peers { permanent_uuid: "9a0d6a444b7f492ca8c890ed7ee45675" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44083 } }
I20260812 02:46:36.791085 10848 consensus_queue.cc:260] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c8288964a24a3fb60c37bf6a300a81" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41481 } } peers { permanent_uuid: "fd42726726f54953aca50426cbf14496" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46607 } } peers { permanent_uuid: "9a0d6a444b7f492ca8c890ed7ee45675" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44083 } }
I20260812 02:46:36.791829 10850 raft_consensus.cc:348] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c8288964a24a3fb60c37bf6a300a81" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41481 } } peers { permanent_uuid: "fd42726726f54953aca50426cbf14496" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46607 } } peers { permanent_uuid: "9a0d6a444b7f492ca8c890ed7ee45675" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44083 } }
I20260812 02:46:36.792121 10848 ts_tablet_manager.cc:1428] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 02:46:36.792125 10852 ts_tablet_manager.cc:1428] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 02:46:36.792174 10850 raft_consensus.cc:374] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:36.792279 10850 raft_consensus.cc:729] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd42726726f54953aca50426cbf14496, State: Initialized, Role: FOLLOWER
I20260812 02:46:36.792467 10814 heartbeater.cc:503] Master 127.10.75.126:44423 was elected leader, sending a full tablet report...
I20260812 02:46:36.792726 10850 consensus_queue.cc:260] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c8288964a24a3fb60c37bf6a300a81" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41481 } } peers { permanent_uuid: "fd42726726f54953aca50426cbf14496" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46607 } } peers { permanent_uuid: "9a0d6a444b7f492ca8c890ed7ee45675" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44083 } }
I20260812 02:46:36.792821 10310 heartbeater.cc:503] Master 127.10.75.126:44423 was elected leader, sending a full tablet report...
I20260812 02:46:36.793665 10850 ts_tablet_manager.cc:1428] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 02:46:36.793757 10575 heartbeater.cc:503] Master 127.10.75.126:44423 was elected leader, sending a full tablet report...
W20260812 02:46:36.968972 10816 tablet.cc:2369] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:46:36.980960 10858 raft_consensus.cc:482] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:46:36.981197 10858 raft_consensus.cc:504] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c8288964a24a3fb60c37bf6a300a81" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41481 } } peers { permanent_uuid: "fd42726726f54953aca50426cbf14496" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46607 } } peers { permanent_uuid: "9a0d6a444b7f492ca8c890ed7ee45675" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44083 } }
I20260812 02:46:36.982450 10858 leader_election.cc:288] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd42726726f54953aca50426cbf14496 (127.10.75.66:46607), 9a0d6a444b7f492ca8c890ed7ee45675 (127.10.75.67:44083)
I20260812 02:46:36.986687 10846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:36.982900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:56751 (local address 127.10.75.67:44083)
0812 02:46:36.983045 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:36.983050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:36.983280 (+ 230us) server_negotiation.cc:407] Connection header received
0812 02:46:36.983456 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:36.983460 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:36.983502 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:36.983583 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:36.983873 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.984383 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.985662 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.986107 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.986250 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:36.986306 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:36.986486 (+ 180us) server_negotiation.cc:299] Negotiation successful
0812 02:46:36.986555 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 02:46:36.986694 10842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:36.982976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:35049 (local address 127.10.75.66:46607)
0812 02:46:36.983105 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:36.983110 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:36.983429 (+ 319us) server_negotiation.cc:407] Connection header received
0812 02:46:36.983588 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:36.983591 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:36.983648 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:36.983745 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:36.984021 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.984522 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.985647 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.986113 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.986252 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:36.986307 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:36.986504 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 02:46:36.986572 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 02:46:36.986704 10864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:36.982773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:44083 (local address 127.10.75.65:56751)
0812 02:46:36.983182 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:36.983195 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:36.983339 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:36.983608 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:36.983611 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:36.983629 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:36.983760 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:36.983766 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.984511 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.984516 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:36.985529 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:36.985539 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.986241 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.986245 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:36.986347 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:36.986377 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 02:46:36.986467 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 02:46:36.986541 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"mutex_wait_us":51,"thread_start_us":106,"threads_started":1}
I20260812 02:46:36.986713 10865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:36.982773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:46607 (local address 127.10.75.65:35049)
0812 02:46:36.983315 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:36.983328 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:36.983470 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:36.983752 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:36.983755 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:36.983773 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:36.983903 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:36.983908 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.984637 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.984642 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:36.985515 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:36.985526 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:36.986250 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:36.986254 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:36.986378 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:36.986396 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 02:46:36.986488 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 02:46:36.986557 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"mutex_wait_us":51,"thread_start_us":104,"threads_started":1}
I20260812 02:46:36.987462 10737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2bac4bf295d4ff5a462d505d76f5f27" candidate_uuid: "26c8288964a24a3fb60c37bf6a300a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a0d6a444b7f492ca8c890ed7ee45675" is_pre_election: true
I20260812 02:46:36.987460 10473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2bac4bf295d4ff5a462d505d76f5f27" candidate_uuid: "26c8288964a24a3fb60c37bf6a300a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd42726726f54953aca50426cbf14496" is_pre_election: true
I20260812 02:46:36.987756 10737 raft_consensus.cc:2454] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26c8288964a24a3fb60c37bf6a300a81 in term 0.
I20260812 02:46:36.987780 10473 raft_consensus.cc:2454] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26c8288964a24a3fb60c37bf6a300a81 in term 0.
I20260812 02:46:36.988224 10083 leader_election.cc:302] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26c8288964a24a3fb60c37bf6a300a81, 9a0d6a444b7f492ca8c890ed7ee45675; no voters:
I20260812 02:46:36.988518 10858 raft_consensus.cc:2781] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:46:36.988610 10858 raft_consensus.cc:482] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:46:36.988656 10858 raft_consensus.cc:3037] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:36.989794 10858 raft_consensus.cc:504] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c8288964a24a3fb60c37bf6a300a81" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41481 } } peers { permanent_uuid: "fd42726726f54953aca50426cbf14496" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46607 } } peers { permanent_uuid: "9a0d6a444b7f492ca8c890ed7ee45675" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44083 } }
I20260812 02:46:36.990226 10858 leader_election.cc:288] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 [CANDIDATE]: Term 1 election: Requested vote from peers fd42726726f54953aca50426cbf14496 (127.10.75.66:46607), 9a0d6a444b7f492ca8c890ed7ee45675 (127.10.75.67:44083)
I20260812 02:46:36.990599 10473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2bac4bf295d4ff5a462d505d76f5f27" candidate_uuid: "26c8288964a24a3fb60c37bf6a300a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd42726726f54953aca50426cbf14496"
I20260812 02:46:36.990732 10473 raft_consensus.cc:3037] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:36.991770 10473 raft_consensus.cc:2454] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26c8288964a24a3fb60c37bf6a300a81 in term 1.
I20260812 02:46:36.992048 10737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2bac4bf295d4ff5a462d505d76f5f27" candidate_uuid: "26c8288964a24a3fb60c37bf6a300a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a0d6a444b7f492ca8c890ed7ee45675"
I20260812 02:46:36.992105 10080 leader_election.cc:302] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26c8288964a24a3fb60c37bf6a300a81, fd42726726f54953aca50426cbf14496; no voters:
I20260812 02:46:36.992206 10737 raft_consensus.cc:3037] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:36.992285 10858 raft_consensus.cc:2781] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:36.992545 10858 raft_consensus.cc:686] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 [term 1 LEADER]: Becoming Leader. State: Replica: 26c8288964a24a3fb60c37bf6a300a81, State: Running, Role: LEADER
I20260812 02:46:36.992924 10858 consensus_queue.cc:237] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c8288964a24a3fb60c37bf6a300a81" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41481 } } peers { permanent_uuid: "fd42726726f54953aca50426cbf14496" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46607 } } peers { permanent_uuid: "9a0d6a444b7f492ca8c890ed7ee45675" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44083 } }
W20260812 02:46:36.993372 10576 tablet.cc:2369] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:46:36.993472 10737 raft_consensus.cc:2454] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26c8288964a24a3fb60c37bf6a300a81 in term 1.
I20260812 02:46:36.996454 9934 catalog_manager.cc:5495] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26c8288964a24a3fb60c37bf6a300a81 (127.10.75.65). New cstate: current_term: 1 leader_uuid: "26c8288964a24a3fb60c37bf6a300a81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c8288964a24a3fb60c37bf6a300a81" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd42726726f54953aca50426cbf14496" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a0d6a444b7f492ca8c890ed7ee45675" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44083 } health_report { overall_health: UNKNOWN } } }
W20260812 02:46:37.029209 10312 tablet.cc:2369] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:46:37.061267 10839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:37.057768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60152 (local address 127.10.75.65:41481)
0812 02:46:37.057907 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:37.057911 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:37.057924 (+ 13us) server_negotiation.cc:407] Connection header received
0812 02:46:37.058001 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:37.058004 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:37.058116 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:37.058227 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:46:37.058446 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:37.058938 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:37.059795 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:37.060026 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:37.060122 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:37.060436 (+ 314us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:46:37.060912 (+ 476us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:46:37.061018 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:37.061084 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 02:46:37.061140 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 02:46:37.067339 10473 raft_consensus.cc:1261] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496 [term 1 FOLLOWER]: Refusing update from remote peer 26c8288964a24a3fb60c37bf6a300a81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:46:37.067339 10737 raft_consensus.cc:1261] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675 [term 1 FOLLOWER]: Refusing update from remote peer 26c8288964a24a3fb60c37bf6a300a81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:46:37.068166 10868 consensus_queue.cc:1035] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a0d6a444b7f492ca8c890ed7ee45675" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:46:37.068411 10858 consensus_queue.cc:1035] T c2bac4bf295d4ff5a462d505d76f5f27 P 26c8288964a24a3fb60c37bf6a300a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd42726726f54953aca50426cbf14496" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:46:37.076849 10877 mvcc.cc:205] Tried to move back new op lower bound from 7317515456779632640 to 7317515456486019072. Current Snapshot: MvccSnapshot[applied={T|T < 7317515456779632640}]
I20260812 02:46:37.080279 10876 mvcc.cc:205] Tried to move back new op lower bound from 7317515456779632640 to 7317515456486019072. Current Snapshot: MvccSnapshot[applied={T|T < 7317515456779632640}]
I20260812 02:46:37.085767 9935 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36032:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:46:37.085949 9935 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36032:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:46:37.088533 9935 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbaefd3d3e0a4f75aff4a0d00991318f: Sending DeleteTablet for 3 replicas of tablet c2bac4bf295d4ff5a462d505d76f5f27
I20260812 02:46:37.089336 10427 tablet_service.cc:1514] Processing DeleteTablet for tablet c2bac4bf295d4ff5a462d505d76f5f27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:46:37 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:60904
I20260812 02:46:37.089344 10173 tablet_service.cc:1514] Processing DeleteTablet for tablet c2bac4bf295d4ff5a462d505d76f5f27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:46:37 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:60146
I20260812 02:46:37.089963 10885 tablet_replica.cc:330] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496: stopping tablet replica
I20260812 02:46:37.090016 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 10052
I20260812 02:46:37.089979 10700 tablet_service.cc:1514] Processing DeleteTablet for tablet c2bac4bf295d4ff5a462d505d76f5f27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:46:37 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:42596
I20260812 02:46:37.096662 10890 tablet_replica.cc:330] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675: stopping tablet replica
I20260812 02:46:37.096794 10885 raft_consensus.cc:2229] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:46:37.096982 10890 raft_consensus.cc:2229] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:46:37.097151 10885 raft_consensus.cc:2258] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:46:37.097316 10890 raft_consensus.cc:2258] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:46:37.098629 10885 ts_tablet_manager.cc:1905] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:46:37.101732 10885 ts_tablet_manager.cc:1918] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:46:37.101845 10885 log.cc:1196] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/c2bac4bf295d4ff5a462d505d76f5f27
I20260812 02:46:37.102240 10885 ts_tablet_manager.cc:1939] T c2bac4bf295d4ff5a462d505d76f5f27 P fd42726726f54953aca50426cbf14496: Deleting consensus metadata
I20260812 02:46:37.102563 10890 ts_tablet_manager.cc:1905] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:46:37.103506 9906 catalog_manager.cc:4841] TS fd42726726f54953aca50426cbf14496 (127.10.75.66:46607): tablet c2bac4bf295d4ff5a462d505d76f5f27 (table test-table [id=0cc719ac118c46248ee004eab6bc9106]) successfully deleted
I20260812 02:46:37.104811 10890 ts_tablet_manager.cc:1918] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:46:37.104890 10890 log.cc:1196] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/c2bac4bf295d4ff5a462d505d76f5f27
I20260812 02:46:37.105233 10890 ts_tablet_manager.cc:1939] T c2bac4bf295d4ff5a462d505d76f5f27 P 9a0d6a444b7f492ca8c890ed7ee45675: Deleting consensus metadata
I20260812 02:46:37.106232 9908 catalog_manager.cc:4841] TS 9a0d6a444b7f492ca8c890ed7ee45675 (127.10.75.67:44083): tablet c2bac4bf295d4ff5a462d505d76f5f27 (table test-table [id=0cc719ac118c46248ee004eab6bc9106]) successfully deleted
W20260812 02:46:37.108208 9908 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.75.65:41481 (error 108)
I20260812 02:46:37.108302 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 10319
I20260812 02:46:37.120782 10845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:37.119924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:41481 (local address 127.0.0.1:60154)
0812 02:46:37.120628 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:37.120700 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.65:41481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":588}
W20260812 02:46:37.121030 9908 catalog_manager.cc:4584] TS 26c8288964a24a3fb60c37bf6a300a81 (127.10.75.65:41481): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c2bac4bf295d4ff5a462d505d76f5f27: Network error: Client connection negotiation failed: client connection to 127.10.75.65:41481: connect: Connection refused (error 111)
I20260812 02:46:37.126405 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 10583
I20260812 02:46:37.138562 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 9879
2026-08-12T02:46:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2827 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T02:46:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:46:37Z Disabled control of system clock
I20260812 02:46:37.185076 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:39933
--webserver_interface=127.10.75.126
--webserver_port=0
--builtin_ntp_servers=127.10.75.84:35795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:39933
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 02:46:37.296738 10896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:37.297012 10896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:37.297049 10896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:37.301116 10896 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:46:37.301177 10896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:37.301193 10896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:37.301210 10896 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:46:37.301231 10896 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:46:37.306005 10896 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:35795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:39933
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:39933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:37.307123 10896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:37.308538 10896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:37.317001 10915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:37.317023 10920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:37.317008 10914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:37.317269 10896 server_base.cc:1034] running on GCE node
I20260812 02:46:37.317983 10896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:37.319056 10896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:37.320231 10896 hybrid_clock.cc:648] HybridClock initialized: now 1786502797320211 us; error 30 us; skew 500 ppm
I20260812 02:46:37.322021 10896 webserver.cc:460] Webserver started at http://127.10.75.126:46517/ using document root <none> and password file <none>
I20260812 02:46:37.322716 10896 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:37.322816 10896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:37.323024 10896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:37.325029 10896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "0e4392a51b6748eea01014f877bac7e3"
format_stamp: "Formatted at 2026-08-12 02:46:37 on dist-test-slave-2p8l"
server_key: "6bf75572fc5e52689ca2ffde85c88a78"
server_key_iv: "57c5ebb4eb534a514612f4c8e3d1ee64"
server_key_version: "encryptionkey@0"
I20260812 02:46:37.325587 10896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "0e4392a51b6748eea01014f877bac7e3"
format_stamp: "Formatted at 2026-08-12 02:46:37 on dist-test-slave-2p8l"
server_key: "6bf75572fc5e52689ca2ffde85c88a78"
server_key_iv: "57c5ebb4eb534a514612f4c8e3d1ee64"
server_key_version: "encryptionkey@0"
I20260812 02:46:37.329321 10896 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260812 02:46:37.331770 10930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:37.332947 10896 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:46:37.333108 10896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "0e4392a51b6748eea01014f877bac7e3"
format_stamp: "Formatted at 2026-08-12 02:46:37 on dist-test-slave-2p8l"
server_key: "6bf75572fc5e52689ca2ffde85c88a78"
server_key_iv: "57c5ebb4eb534a514612f4c8e3d1ee64"
server_key_version: "encryptionkey@0"
I20260812 02:46:37.333228 10896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:37.342797 10896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:37.343608 10896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:37.343750 10896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:37.350229 10896 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:39933
I20260812 02:46:37.350276 11033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:39933 every 8 connection(s)
I20260812 02:46:37.351128 10896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:46:37.354038 11035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:37.359392 11035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3: Bootstrap starting.
I20260812 02:46:37.361317 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 10896
I20260812 02:46:37.361472 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:46:37.361761 10541 external_mini_cluster.cc:1428] Setting key 41dd7f58d6747842b688d5f4afe2a052
I20260812 02:46:37.361814 11035 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:37.362794 11035 log.cc:824] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:37.364882 11035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3: No bootstrap required, opened a new log
I20260812 02:46:37.369123 11035 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e4392a51b6748eea01014f877bac7e3" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39933 } }
I20260812 02:46:37.369324 11035 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:37.369383 11035 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e4392a51b6748eea01014f877bac7e3, State: Initialized, Role: FOLLOWER
I20260812 02:46:37.369822 11035 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e4392a51b6748eea01014f877bac7e3" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39933 } }
I20260812 02:46:37.370031 11035 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:46:37.370167 11035 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:46:37.370293 11035 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:37.370918 11040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:37.362935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55290 (local address 127.10.75.126:39933)
0812 02:46:37.363614 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:37.363629 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:37.363662 (+ 33us) server_negotiation.cc:407] Connection header received
0812 02:46:37.364280 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:37.364297 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:37.364615 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:37.364873 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:37.365264 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:37.366258 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:37.367449 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:37.367906 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:37.368020 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:37.369007 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:37.369012 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:37.369024 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:37.369466 (+ 442us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:37.369528 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:37.369550 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:37.369685 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:37.369826 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 02:46:37.370131 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":193,"threads_started":1}
I20260812 02:46:37.371214 11035 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e4392a51b6748eea01014f877bac7e3" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39933 } }
I20260812 02:46:37.371548 11035 leader_election.cc:302] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e4392a51b6748eea01014f877bac7e3; no voters:
I20260812 02:46:37.371881 11035 leader_election.cc:288] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:46:37.371946 11044 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:37.372187 11044 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0e4392a51b6748eea01014f877bac7e3, State: Running, Role: LEADER
I20260812 02:46:37.372534 11044 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e4392a51b6748eea01014f877bac7e3" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39933 } }
I20260812 02:46:37.373167 11035 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:46:37.373706 11048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e4392a51b6748eea01014f877bac7e3. Latest consensus state: current_term: 1 leader_uuid: "0e4392a51b6748eea01014f877bac7e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e4392a51b6748eea01014f877bac7e3" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39933 } } }
I20260812 02:46:37.373838 11048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3 [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:37.374162 11045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e4392a51b6748eea01014f877bac7e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e4392a51b6748eea01014f877bac7e3" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39933 } } }
I20260812 02:46:37.374295 11045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3 [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:37.375427 11052 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:46:37.378727 11052 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:46:37.383612 11052 catalog_manager.cc:1347] Generated new cluster ID: 7edc8fba295641c99f94c0a53c06ed8f
I20260812 02:46:37.383677 11052 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:46:37.416298 11052 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:46:37.417531 11052 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:46:37.426190 11052 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3: Generated new TSK 0
I20260812 02:46:37.426939 11052 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:46:37.434303 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:39933
--builtin_ntp_servers=127.10.75.84:35795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 02:46:37.547273 11077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:37.547515 11077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:37.547552 11077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:37.551600 11077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:37.551652 11077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:37.551705 11077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:46:37.556345 11077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:35795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:39933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:37.557346 11077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:37.558683 11077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:37.568572 11088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:37.568689 11084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:37.568567 11083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:37.568851 11077 server_base.cc:1034] running on GCE node
I20260812 02:46:37.569344 11077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:37.570039 11077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:37.571285 11077 hybrid_clock.cc:648] HybridClock initialized: now 1786502797571252 us; error 44 us; skew 500 ppm
I20260812 02:46:37.573262 11077 webserver.cc:460] Webserver started at http://127.10.75.65:46361/ using document root <none> and password file <none>
I20260812 02:46:37.573915 11077 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:37.574010 11077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:37.574287 11077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:37.576428 11077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "61da7a6fd4e3489e84e3d8ba1492943b"
format_stamp: "Formatted at 2026-08-12 02:46:37 on dist-test-slave-2p8l"
server_key: "5f254d477eec9d6ac890db148ad9e0a8"
server_key_iv: "df017ea61d94e3e97886cc56137b31cf"
server_key_version: "encryptionkey@0"
I20260812 02:46:37.577009 11077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "61da7a6fd4e3489e84e3d8ba1492943b"
format_stamp: "Formatted at 2026-08-12 02:46:37 on dist-test-slave-2p8l"
server_key: "5f254d477eec9d6ac890db148ad9e0a8"
server_key_iv: "df017ea61d94e3e97886cc56137b31cf"
server_key_version: "encryptionkey@0"
I20260812 02:46:37.580742 11077 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 02:46:37.583250 11094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:37.584450 11077 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:46:37.584594 11077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "61da7a6fd4e3489e84e3d8ba1492943b"
format_stamp: "Formatted at 2026-08-12 02:46:37 on dist-test-slave-2p8l"
server_key: "5f254d477eec9d6ac890db148ad9e0a8"
server_key_iv: "df017ea61d94e3e97886cc56137b31cf"
server_key_version: "encryptionkey@0"
I20260812 02:46:37.584738 11077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:37.597273 11077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:37.597932 11077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:37.598171 11077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:37.598769 11077 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:37.599690 11077 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:37.599764 11077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:37.599839 11077 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:37.599884 11077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:37.608762 11077 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:34609
I20260812 02:46:37.608793 11294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:34609 every 8 connection(s)
I20260812 02:46:37.609642 11077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:46:37.611579 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 11077
I20260812 02:46:37.611756 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:46:37.612143 10541 external_mini_cluster.cc:1428] Setting key 750f676d54c6b740e2baf13ea0f3ca82
I20260812 02:46:37.614315 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:39933
--builtin_ntp_servers=127.10.75.84:35795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 02:46:37.620253 11040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:37.611946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:50647 (local address 127.10.75.126:39933)
0812 02:46:37.612146 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:37.612151 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:37.612804 (+ 653us) server_negotiation.cc:407] Connection header received
0812 02:46:37.614427 (+ 1623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:37.614433 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:37.614498 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:37.614598 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:37.615457 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:37.616326 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:37.618124 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:37.618348 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:37.618432 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:37.619782 (+ 1350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:37.619785 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:37.619787 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:37.619799 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:37.619817 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:37.619825 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:37.619886 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:37.620091 (+ 205us) server_negotiation.cc:299] Negotiation successful
0812 02:46:37.620141 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 02:46:37.621495 11301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:37.611911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:39933 (local address 127.10.75.65:50647)
0812 02:46:37.612654 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:37.612705 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:37.614209 (+ 1504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:37.614770 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:37.614777 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:37.614855 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:37.615313 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:37.615325 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:37.616473 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:37.616479 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:37.617943 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:37.617958 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:37.618510 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:37.618517 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:37.618787 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:37.619461 (+ 674us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:46:37.619464 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:37.619518 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:46:37.619605 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:37.619920 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:37.619933 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:37.619943 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 02:46:37.620088 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 02:46:37.620409 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":150,"threads_started":1}
I20260812 02:46:37.622822 11295 heartbeater.cc:347] Connected to a master server at 127.10.75.126:39933
I20260812 02:46:37.623098 11295 heartbeater.cc:464] Registering TS with master...
I20260812 02:46:37.623625 11295 heartbeater.cc:511] Master 127.10.75.126:39933 requested a full tablet report, sending...
I20260812 02:46:37.625162 10971 ts_manager.cc:194] Registered new tserver with Master: 61da7a6fd4e3489e84e3d8ba1492943b (127.10.75.65:34609)
I20260812 02:46:37.626361 10971 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.75.65:50647
W20260812 02:46:37.728868 11302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:37.729146 11302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:37.729226 11302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:37.733165 11302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:37.733246 11302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:37.733335 11302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:46:37.738137 11302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:35795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:39933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:37.739235 11302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:37.740576 11302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:37.750401 11309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:37.750397 11313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:37.750380 11310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:37.750653 11302 server_base.cc:1034] running on GCE node
I20260812 02:46:37.751067 11302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:37.751735 11302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:37.752954 11302 hybrid_clock.cc:648] HybridClock initialized: now 1786502797752941 us; error 34 us; skew 500 ppm
I20260812 02:46:37.755048 11302 webserver.cc:460] Webserver started at http://127.10.75.66:45069/ using document root <none> and password file <none>
I20260812 02:46:37.755671 11302 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:37.755775 11302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:37.756032 11302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:37.758355 11302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "51b2ad244dff434ea9f0adf71772e033"
format_stamp: "Formatted at 2026-08-12 02:46:37 on dist-test-slave-2p8l"
server_key: "4a02225474428a75558dda4975185192"
server_key_iv: "606a10b0b74be9182e3fb9ff3e681806"
server_key_version: "encryptionkey@0"
I20260812 02:46:37.758975 11302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "51b2ad244dff434ea9f0adf71772e033"
format_stamp: "Formatted at 2026-08-12 02:46:37 on dist-test-slave-2p8l"
server_key: "4a02225474428a75558dda4975185192"
server_key_iv: "606a10b0b74be9182e3fb9ff3e681806"
server_key_version: "encryptionkey@0"
I20260812 02:46:37.762960 11302 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 02:46:37.765470 11323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:37.766654 11302 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:46:37.766788 11302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "51b2ad244dff434ea9f0adf71772e033"
format_stamp: "Formatted at 2026-08-12 02:46:37 on dist-test-slave-2p8l"
server_key: "4a02225474428a75558dda4975185192"
server_key_iv: "606a10b0b74be9182e3fb9ff3e681806"
server_key_version: "encryptionkey@0"
I20260812 02:46:37.766897 11302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:37.778000 11302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:37.778685 11302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:37.778877 11302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:37.779436 11302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:37.780340 11302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:37.780421 11302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:37.780512 11302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:37.780565 11302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:37.790009 11302 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:37197
I20260812 02:46:37.790040 11532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:37197 every 8 connection(s)
I20260812 02:46:37.790980 11302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:46:37.792068 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 11302
I20260812 02:46:37.792205 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:46:37.792510 10541 external_mini_cluster.cc:1428] Setting key 6028087e5e68a05f7fa7f0635f327bb8
I20260812 02:46:37.794885 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:39933
--builtin_ntp_servers=127.10.75.84:35795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 02:46:37.803298 11040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:37.793056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:52941 (local address 127.10.75.126:39933)
0812 02:46:37.793194 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:37.793199 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:37.794619 (+ 1420us) server_negotiation.cc:407] Connection header received
0812 02:46:37.796691 (+ 2072us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:37.796694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:37.796740 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:37.796862 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:37.797820 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:37.798659 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:37.800446 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:37.800859 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:37.800966 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:37.802764 (+ 1798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:37.802767 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:37.802769 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:37.802782 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:37.802802 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:37.802810 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:37.802879 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:37.803100 (+ 221us) server_negotiation.cc:299] Negotiation successful
0812 02:46:37.803156 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 02:46:37.804621 11537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:37.793568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:39933 (local address 127.10.75.66:52941)
0812 02:46:37.794455 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:37.794508 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:37.796445 (+ 1937us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:37.797077 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:37.797086 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:37.797187 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:37.797659 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:37.797672 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:37.798802 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:37.798809 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:37.800316 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:37.800330 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:37.801047 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:37.801053 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:37.801304 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:37.802397 (+ 1093us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:46:37.802401 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:37.802462 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:46:37.802560 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:37.802910 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:37.802923 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:37.802933 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 02:46:37.803082 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 02:46:37.803423 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":152,"threads_started":1}
I20260812 02:46:37.805907 11533 heartbeater.cc:347] Connected to a master server at 127.10.75.126:39933
I20260812 02:46:37.806228 11533 heartbeater.cc:464] Registering TS with master...
I20260812 02:46:37.806785 11533 heartbeater.cc:511] Master 127.10.75.126:39933 requested a full tablet report, sending...
I20260812 02:46:37.807915 10971 ts_manager.cc:194] Registered new tserver with Master: 51b2ad244dff434ea9f0adf71772e033 (127.10.75.66:37197)
I20260812 02:46:37.808495 10971 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.75.66:52941
W20260812 02:46:37.910970 11540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:37.911248 11540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:37.911286 11540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:37.915366 11540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:37.915414 11540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:37.915499 11540 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:46:37.920249 11540 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:35795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:39933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11540
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:37.921360 11540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:37.923002 11540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:37.933301 11554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:37.933338 11557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:37.933406 11540 server_base.cc:1034] running on GCE node
W20260812 02:46:37.933528 11559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:37.933980 11540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:37.934666 11540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:37.935843 11540 hybrid_clock.cc:648] HybridClock initialized: now 1786502797935806 us; error 47 us; skew 500 ppm
I20260812 02:46:37.937810 11540 webserver.cc:460] Webserver started at http://127.10.75.67:41063/ using document root <none> and password file <none>
I20260812 02:46:37.938421 11540 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:37.938485 11540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:37.938654 11540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:37.940832 11540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "bcfb07284e404cf09f25d132a7974ebd"
format_stamp: "Formatted at 2026-08-12 02:46:37 on dist-test-slave-2p8l"
server_key: "5aee0859a22d24c480a173e503571859"
server_key_iv: "0f2e757c31a948a38ebe2e9e45c84184"
server_key_version: "encryptionkey@0"
I20260812 02:46:37.941395 11540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "bcfb07284e404cf09f25d132a7974ebd"
format_stamp: "Formatted at 2026-08-12 02:46:37 on dist-test-slave-2p8l"
server_key: "5aee0859a22d24c480a173e503571859"
server_key_iv: "0f2e757c31a948a38ebe2e9e45c84184"
server_key_version: "encryptionkey@0"
I20260812 02:46:37.945154 11540 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 02:46:37.947505 11569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:37.948724 11540 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:46:37.948853 11540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "bcfb07284e404cf09f25d132a7974ebd"
format_stamp: "Formatted at 2026-08-12 02:46:37 on dist-test-slave-2p8l"
server_key: "5aee0859a22d24c480a173e503571859"
server_key_iv: "0f2e757c31a948a38ebe2e9e45c84184"
server_key_version: "encryptionkey@0"
I20260812 02:46:37.948958 11540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:37.996902 11540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:37.997663 11540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:37.997871 11540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:37.998572 11540 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:37.999549 11540 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:37.999599 11540 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:37.999720 11540 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:37.999760 11540 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:38.008627 11540 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:43927
I20260812 02:46:38.008641 11777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:43927 every 8 connection(s)
I20260812 02:46:38.009533 11540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:46:38.013733 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 11540
I20260812 02:46:38.013880 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:46:38.014212 10541 external_mini_cluster.cc:1428] Setting key 70c4227388070eeeaa8b59cf297d3273
I20260812 02:46:38.019441 11040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:38.011373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:44985 (local address 127.10.75.126:39933)
0812 02:46:38.011514 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:38.011518 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:38.012552 (+ 1034us) server_negotiation.cc:407] Connection header received
0812 02:46:38.014324 (+ 1772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:38.014329 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:38.014389 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:38.014466 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:38.015554 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.016305 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.017460 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.017675 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.017761 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:38.018955 (+ 1194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:38.018958 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:38.018960 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:38.018972 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:38.018992 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:38.019001 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:38.019075 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:38.019259 (+ 184us) server_negotiation.cc:299] Negotiation successful
0812 02:46:38.019317 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 02:46:38.020253 11785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:38.011775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:39933 (local address 127.10.75.67:44985)
0812 02:46:38.012404 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:38.012445 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:38.014009 (+ 1564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:38.014674 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:38.014681 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:38.014762 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:38.015390 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:38.015414 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.016457 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.016461 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:38.017345 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:38.017355 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.017813 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.017816 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:38.017957 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:38.018682 (+ 725us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:46:38.018684 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:38.018723 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:46:38.018786 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:38.019087 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:38.019094 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:38.019098 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 02:46:38.019195 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 02:46:38.019416 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":106,"threads_started":1}
I20260812 02:46:38.021662 11783 heartbeater.cc:347] Connected to a master server at 127.10.75.126:39933
I20260812 02:46:38.021879 11783 heartbeater.cc:464] Registering TS with master...
I20260812 02:46:38.022384 11783 heartbeater.cc:511] Master 127.10.75.126:39933 requested a full tablet report, sending...
I20260812 02:46:38.023416 10971 ts_manager.cc:194] Registered new tserver with Master: bcfb07284e404cf09f25d132a7974ebd (127.10.75.67:43927)
I20260812 02:46:38.024101 10971 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.75.67:44985
I20260812 02:46:38.028164 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:46:38.034719 11040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:38.030743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55296 (local address 127.10.75.126:39933)
0812 02:46:38.030869 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:38.030872 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:38.031041 (+ 169us) server_negotiation.cc:407] Connection header received
0812 02:46:38.031144 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:38.031147 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:38.031185 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:38.031256 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:38.031564 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.032083 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.032966 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.033180 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.033275 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:38.034275 (+ 1000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:38.034278 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:38.034280 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:38.034292 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:38.034315 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:38.034324 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:38.034388 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:38.034508 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 02:46:38.034604 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 02:46:38.038322 10971 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55296:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:46:38.041323 10971 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:46:38.057379 11802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:38.051434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:43927 (local address 127.0.0.1:53278)
0812 02:46:38.052557 (+ 1123us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:38.052572 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:38.052654 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:38.053319 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:38.053323 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:38.053342 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:38.053440 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:38.053445 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.054622 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.054625 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:38.055957 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:38.055968 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.056784 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.056788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:38.056894 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:38.056932 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 02:46:38.057047 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 02:46:38.057210 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1054,"mutex_wait_us":77,"thread_start_us":136,"threads_started":1}
I20260812 02:46:38.057425 11807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:38.051125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:34609 (local address 127.0.0.1:46414)
0812 02:46:38.052307 (+ 1182us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:38.052321 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:38.052417 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:38.053201 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:38.053204 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:38.053225 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:38.053328 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:38.053335 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.054921 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.054925 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:38.055960 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:38.055970 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.057074 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.057078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:38.057178 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:38.057199 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 02:46:38.057262 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 02:46:38.057316 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1118,"mutex_wait_us":112,"thread_start_us":106,"threads_started":1}
I20260812 02:46:38.057864 11815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:38.051874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46414 (local address 127.10.75.65:34609)
0812 02:46:38.052757 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:38.052771 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:38.052791 (+ 20us) server_negotiation.cc:407] Connection header received
0812 02:46:38.052856 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:38.052860 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:38.053016 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:38.053198 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:38.053481 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.054779 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.056099 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.056961 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.057074 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:38.057265 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:38.057324 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 02:46:38.057432 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":762,"thread_start_us":139,"threads_started":1}
I20260812 02:46:38.058151 11812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:38.051839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53278 (local address 127.10.75.67:43927)
0812 02:46:38.052345 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:38.052357 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:38.052750 (+ 393us) server_negotiation.cc:407] Connection header received
0812 02:46:38.052837 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:38.052842 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:38.053017 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:38.053170 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:38.053626 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.054487 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.056106 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.056649 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.056783 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:38.056976 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:38.057843 (+ 867us) server_negotiation.cc:299] Negotiation successful
0812 02:46:38.057965 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":126,"threads_started":1}
I20260812 02:46:38.059412 11803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:38.050996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:37197 (local address 127.0.0.1:45030)
0812 02:46:38.051721 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:38.051776 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:38.051917 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:38.052790 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:38.052797 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:38.052822 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:38.052984 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:38.052991 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.054564 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.054569 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:38.057248 (+ 2679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:38.057260 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.058963 (+ 1703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.058967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:38.059080 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:38.059106 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 02:46:38.059196 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 02:46:38.059270 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"mutex_wait_us":1279,"thread_start_us":96,"threads_started":1}
I20260812 02:46:38.059450 11804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:38.051159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45030 (local address 127.10.75.66:37197)
0812 02:46:38.052263 (+ 1104us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:38.052277 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:38.052304 (+ 27us) server_negotiation.cc:407] Connection header received
0812 02:46:38.052394 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:38.052402 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:38.052626 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:38.052797 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:38.053118 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.054438 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.057402 (+ 2964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.058596 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.058713 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:38.058892 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:38.059245 (+ 353us) server_negotiation.cc:299] Negotiation successful
0812 02:46:38.059328 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":982,"thread_start_us":140,"threads_started":1}
I20260812 02:46:38.061240 11182 tablet_service.cc:1467] Processing CreateTablet for tablet e2d34de8287142c5b68739db6ca5caf2 (DEFAULT_TABLE table=test-table [id=5214d62475d94601be2ec4a732eb559d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:46:38.061759 11413 tablet_service.cc:1467] Processing CreateTablet for tablet e2d34de8287142c5b68739db6ca5caf2 (DEFAULT_TABLE table=test-table [id=5214d62475d94601be2ec4a732eb559d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:46:38.062527 11182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2d34de8287142c5b68739db6ca5caf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:38.062311 11655 tablet_service.cc:1467] Processing CreateTablet for tablet e2d34de8287142c5b68739db6ca5caf2 (DEFAULT_TABLE table=test-table [id=5214d62475d94601be2ec4a732eb559d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:46:38.062857 11413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2d34de8287142c5b68739db6ca5caf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:38.063282 11655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2d34de8287142c5b68739db6ca5caf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:38.068909 11819 tablet_bootstrap.cc:492] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033: Bootstrap starting.
I20260812 02:46:38.071144 11820 tablet_bootstrap.cc:492] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b: Bootstrap starting.
I20260812 02:46:38.071143 11821 tablet_bootstrap.cc:492] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd: Bootstrap starting.
I20260812 02:46:38.071277 11819 tablet_bootstrap.cc:654] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:38.071992 11819 log.cc:824] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:38.073491 11821 tablet_bootstrap.cc:654] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:38.073491 11820 tablet_bootstrap.cc:654] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:38.074491 11819 tablet_bootstrap.cc:492] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033: No bootstrap required, opened a new log
I20260812 02:46:38.074536 11821 log.cc:824] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:38.074548 11820 log.cc:824] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:38.074720 11819 ts_tablet_manager.cc:1397] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 02:46:38.076499 11821 tablet_bootstrap.cc:492] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd: No bootstrap required, opened a new log
I20260812 02:46:38.076773 11821 ts_tablet_manager.cc:1397] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 02:46:38.078167 11820 tablet_bootstrap.cc:492] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b: No bootstrap required, opened a new log
I20260812 02:46:38.078372 11820 ts_tablet_manager.cc:1397] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20260812 02:46:38.078409 11819 raft_consensus.cc:348] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51b2ad244dff434ea9f0adf71772e033" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 37197 } } peers { permanent_uuid: "61da7a6fd4e3489e84e3d8ba1492943b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34609 } } peers { permanent_uuid: "bcfb07284e404cf09f25d132a7974ebd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43927 } }
I20260812 02:46:38.078706 11819 raft_consensus.cc:374] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:38.078760 11819 raft_consensus.cc:729] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51b2ad244dff434ea9f0adf71772e033, State: Initialized, Role: FOLLOWER
I20260812 02:46:38.079262 11819 consensus_queue.cc:260] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51b2ad244dff434ea9f0adf71772e033" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 37197 } } peers { permanent_uuid: "61da7a6fd4e3489e84e3d8ba1492943b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34609 } } peers { permanent_uuid: "bcfb07284e404cf09f25d132a7974ebd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43927 } }
I20260812 02:46:38.080523 11819 ts_tablet_manager.cc:1428] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 02:46:38.080925 11533 heartbeater.cc:503] Master 127.10.75.126:39933 was elected leader, sending a full tablet report...
I20260812 02:46:38.081511 11821 raft_consensus.cc:348] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51b2ad244dff434ea9f0adf71772e033" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 37197 } } peers { permanent_uuid: "61da7a6fd4e3489e84e3d8ba1492943b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34609 } } peers { permanent_uuid: "bcfb07284e404cf09f25d132a7974ebd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43927 } }
I20260812 02:46:38.081797 11821 raft_consensus.cc:374] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:38.081857 11821 raft_consensus.cc:729] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcfb07284e404cf09f25d132a7974ebd, State: Initialized, Role: FOLLOWER
I20260812 02:46:38.082355 11821 consensus_queue.cc:260] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51b2ad244dff434ea9f0adf71772e033" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 37197 } } peers { permanent_uuid: "61da7a6fd4e3489e84e3d8ba1492943b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34609 } } peers { permanent_uuid: "bcfb07284e404cf09f25d132a7974ebd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43927 } }
I20260812 02:46:38.083202 11783 heartbeater.cc:503] Master 127.10.75.126:39933 was elected leader, sending a full tablet report...
I20260812 02:46:38.083051 11820 raft_consensus.cc:348] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51b2ad244dff434ea9f0adf71772e033" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 37197 } } peers { permanent_uuid: "61da7a6fd4e3489e84e3d8ba1492943b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34609 } } peers { permanent_uuid: "bcfb07284e404cf09f25d132a7974ebd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43927 } }
I20260812 02:46:38.083297 11820 raft_consensus.cc:374] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:38.083351 11820 raft_consensus.cc:729] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61da7a6fd4e3489e84e3d8ba1492943b, State: Initialized, Role: FOLLOWER
I20260812 02:46:38.083424 11821 ts_tablet_manager.cc:1428] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260812 02:46:38.083824 11820 consensus_queue.cc:260] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51b2ad244dff434ea9f0adf71772e033" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 37197 } } peers { permanent_uuid: "61da7a6fd4e3489e84e3d8ba1492943b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34609 } } peers { permanent_uuid: "bcfb07284e404cf09f25d132a7974ebd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43927 } }
I20260812 02:46:38.084481 11295 heartbeater.cc:503] Master 127.10.75.126:39933 was elected leader, sending a full tablet report...
I20260812 02:46:38.084847 11820 ts_tablet_manager.cc:1428] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b: Time spent starting tablet: real 0.006s user 0.004s sys 0.002s
W20260812 02:46:38.110955 11300 tablet.cc:2369] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:46:38.239785 11834 raft_consensus.cc:482] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:46:38.239984 11834 raft_consensus.cc:504] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51b2ad244dff434ea9f0adf71772e033" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 37197 } } peers { permanent_uuid: "61da7a6fd4e3489e84e3d8ba1492943b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34609 } } peers { permanent_uuid: "bcfb07284e404cf09f25d132a7974ebd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43927 } }
I20260812 02:46:38.241170 11834 leader_election.cc:288] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51b2ad244dff434ea9f0adf71772e033 (127.10.75.66:37197), bcfb07284e404cf09f25d132a7974ebd (127.10.75.67:43927)
I20260812 02:46:38.247041 11804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:38.241499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:42455 (local address 127.10.75.66:37197)
0812 02:46:38.241691 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:38.241696 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:38.241802 (+ 106us) server_negotiation.cc:407] Connection header received
0812 02:46:38.241972 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:38.241976 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:38.242071 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:38.242156 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:38.242671 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.243464 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.245571 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.246237 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.246372 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:38.246423 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:38.246810 (+ 387us) server_negotiation.cc:299] Negotiation successful
0812 02:46:38.246891 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260812 02:46:38.247031 11812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:38.241535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:48373 (local address 127.10.75.67:43927)
0812 02:46:38.241690 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:38.241696 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:38.241960 (+ 264us) server_negotiation.cc:407] Connection header received
0812 02:46:38.242036 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:38.242040 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:38.242115 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:38.242190 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:38.242704 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.243455 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.245607 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.246248 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.246372 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:38.246423 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:38.246810 (+ 387us) server_negotiation.cc:299] Negotiation successful
0812 02:46:38.246890 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 02:46:38.247093 11841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:38.241414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:43927 (local address 127.10.75.65:48373)
0812 02:46:38.241857 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:38.241871 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:38.241959 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:38.242195 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:38.242197 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:38.242238 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:38.242588 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:38.242597 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.243633 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.243636 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:38.245385 (+ 1749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:38.245400 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.246388 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.246391 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:38.246603 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:38.246673 (+ 70us) client_negotiation.cc:769] Sending connection context
0812 02:46:38.246764 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 02:46:38.246879 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"mutex_wait_us":377,"spinlock_wait_cycles":10624,"thread_start_us":147,"threads_started":1}
I20260812 02:46:38.247112 11835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:38.241393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:37197 (local address 127.10.75.65:42455)
0812 02:46:38.241696 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:38.241713 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:38.241839 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:38.242191 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:38.242194 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:38.242237 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:38.242525 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:38.242533 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.243621 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.243625 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:38.245385 (+ 1760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:38.245400 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.246387 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.246391 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:38.246600 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:38.246673 (+ 73us) client_negotiation.cc:769] Sending connection context
0812 02:46:38.246764 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 02:46:38.246879 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":350,"spinlock_wait_cycles":28672,"thread_start_us":78,"threads_started":1}
I20260812 02:46:38.247902 11451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d34de8287142c5b68739db6ca5caf2" candidate_uuid: "61da7a6fd4e3489e84e3d8ba1492943b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51b2ad244dff434ea9f0adf71772e033" is_pre_election: true
I20260812 02:46:38.247903 11691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d34de8287142c5b68739db6ca5caf2" candidate_uuid: "61da7a6fd4e3489e84e3d8ba1492943b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcfb07284e404cf09f25d132a7974ebd" is_pre_election: true
I20260812 02:46:38.248260 11691 raft_consensus.cc:2454] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61da7a6fd4e3489e84e3d8ba1492943b in term 0.
I20260812 02:46:38.248258 11451 raft_consensus.cc:2454] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61da7a6fd4e3489e84e3d8ba1492943b in term 0.
I20260812 02:46:38.248896 11099 leader_election.cc:302] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 51b2ad244dff434ea9f0adf71772e033, 61da7a6fd4e3489e84e3d8ba1492943b, bcfb07284e404cf09f25d132a7974ebd; no voters:
I20260812 02:46:38.249203 11834 raft_consensus.cc:2781] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:46:38.249294 11834 raft_consensus.cc:482] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:46:38.249338 11834 raft_consensus.cc:3037] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:38.250442 11834 raft_consensus.cc:504] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51b2ad244dff434ea9f0adf71772e033" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 37197 } } peers { permanent_uuid: "61da7a6fd4e3489e84e3d8ba1492943b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34609 } } peers { permanent_uuid: "bcfb07284e404cf09f25d132a7974ebd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43927 } }
I20260812 02:46:38.250785 11834 leader_election.cc:288] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [CANDIDATE]: Term 1 election: Requested vote from peers 51b2ad244dff434ea9f0adf71772e033 (127.10.75.66:37197), bcfb07284e404cf09f25d132a7974ebd (127.10.75.67:43927)
I20260812 02:46:38.251153 11691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d34de8287142c5b68739db6ca5caf2" candidate_uuid: "61da7a6fd4e3489e84e3d8ba1492943b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcfb07284e404cf09f25d132a7974ebd"
I20260812 02:46:38.251186 11451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d34de8287142c5b68739db6ca5caf2" candidate_uuid: "61da7a6fd4e3489e84e3d8ba1492943b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51b2ad244dff434ea9f0adf71772e033"
I20260812 02:46:38.251315 11691 raft_consensus.cc:3037] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:38.251325 11451 raft_consensus.cc:3037] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:38.252460 11691 raft_consensus.cc:2454] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61da7a6fd4e3489e84e3d8ba1492943b in term 1.
I20260812 02:46:38.252594 11451 raft_consensus.cc:2454] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61da7a6fd4e3489e84e3d8ba1492943b in term 1.
I20260812 02:46:38.252885 11099 leader_election.cc:302] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61da7a6fd4e3489e84e3d8ba1492943b, bcfb07284e404cf09f25d132a7974ebd; no voters:
I20260812 02:46:38.253077 11834 raft_consensus.cc:2781] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:38.253352 11834 raft_consensus.cc:686] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [term 1 LEADER]: Becoming Leader. State: Replica: 61da7a6fd4e3489e84e3d8ba1492943b, State: Running, Role: LEADER
I20260812 02:46:38.253696 11834 consensus_queue.cc:237] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51b2ad244dff434ea9f0adf71772e033" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 37197 } } peers { permanent_uuid: "61da7a6fd4e3489e84e3d8ba1492943b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34609 } } peers { permanent_uuid: "bcfb07284e404cf09f25d132a7974ebd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43927 } }
I20260812 02:46:38.257088 10971 catalog_manager.cc:5495] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b reported cstate change: term changed from 0 to 1, leader changed from <none> to 61da7a6fd4e3489e84e3d8ba1492943b (127.10.75.65). New cstate: current_term: 1 leader_uuid: "61da7a6fd4e3489e84e3d8ba1492943b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51b2ad244dff434ea9f0adf71772e033" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 37197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61da7a6fd4e3489e84e3d8ba1492943b" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcfb07284e404cf09f25d132a7974ebd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43927 } health_report { overall_health: UNKNOWN } } }
W20260812 02:46:38.260478 11784 tablet.cc:2369] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:46:38.291925 11815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:38.288153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46430 (local address 127.10.75.65:34609)
0812 02:46:38.288302 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:38.288309 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:38.288325 (+ 16us) server_negotiation.cc:407] Connection header received
0812 02:46:38.288539 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:38.288542 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:38.288668 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:38.288786 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:46:38.289071 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.289659 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.290607 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:38.290833 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:38.290926 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:38.291199 (+ 273us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:46:38.291609 (+ 410us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:46:38.291704 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:38.291761 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 02:46:38.291813 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260812 02:46:38.292258 11536 tablet.cc:2369] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:46:38.297881 11451 raft_consensus.cc:1261] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033 [term 1 FOLLOWER]: Refusing update from remote peer 61da7a6fd4e3489e84e3d8ba1492943b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:46:38.297881 11691 raft_consensus.cc:1261] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd [term 1 FOLLOWER]: Refusing update from remote peer 61da7a6fd4e3489e84e3d8ba1492943b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:46:38.298822 11834 consensus_queue.cc:1035] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [LEADER]: Connected to new peer: Peer: permanent_uuid: "51b2ad244dff434ea9f0adf71772e033" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 37197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:46:38.299050 11845 consensus_queue.cc:1035] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcfb07284e404cf09f25d132a7974ebd" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 43927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:46:38.306905 11849 mvcc.cc:205] Tried to move back new op lower bound from 7317515461820878848 to 7317515461649969152. Current Snapshot: MvccSnapshot[applied={T|T < 7317515461820878848}]
I20260812 02:46:38.307965 11853 mvcc.cc:205] Tried to move back new op lower bound from 7317515461820878848 to 7317515461649969152. Current Snapshot: MvccSnapshot[applied={T|T < 7317515461820878848}]
I20260812 02:46:38.310001 11852 mvcc.cc:205] Tried to move back new op lower bound from 7317515461820878848 to 7317515461649969152. Current Snapshot: MvccSnapshot[applied={T|T < 7317515461820878848}]
I20260812 02:46:38.315785 10971 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:46:38.315936 10971 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:46:38.318506 10971 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0e4392a51b6748eea01014f877bac7e3: Sending DeleteTablet for 3 replicas of tablet e2d34de8287142c5b68739db6ca5caf2
I20260812 02:46:38.319301 11182 tablet_service.cc:1514] Processing DeleteTablet for tablet e2d34de8287142c5b68739db6ca5caf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:46:38 UTC) from {username='slave'} at 127.0.0.1:46414
I20260812 02:46:38.319330 11413 tablet_service.cc:1514] Processing DeleteTablet for tablet e2d34de8287142c5b68739db6ca5caf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:46:38 UTC) from {username='slave'} at 127.0.0.1:45030
I20260812 02:46:38.319464 11655 tablet_service.cc:1514] Processing DeleteTablet for tablet e2d34de8287142c5b68739db6ca5caf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:46:38 UTC) from {username='slave'} at 127.0.0.1:53278
I20260812 02:46:38.319923 11866 tablet_replica.cc:330] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b: stopping tablet replica
I20260812 02:46:38.319967 11865 tablet_replica.cc:330] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033: stopping tablet replica
I20260812 02:46:38.320247 11865 raft_consensus.cc:2229] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:46:38.320248 11866 raft_consensus.cc:2229] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:46:38.320591 11866 raft_consensus.cc:2258] T e2d34de8287142c5b68739db6ca5caf2 P 61da7a6fd4e3489e84e3d8ba1492943b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:46:38.320667 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 11077
I20260812 02:46:38.320740 11865 raft_consensus.cc:2258] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:46:38.326592 11867 tablet_replica.cc:330] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd: stopping tablet replica
I20260812 02:46:38.326936 11867 raft_consensus.cc:2229] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:46:38.327246 11867 raft_consensus.cc:2258] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:46:38.329890 11865 ts_tablet_manager.cc:1905] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:46:38.329903 11867 ts_tablet_manager.cc:1905] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:46:38.332188 11865 ts_tablet_manager.cc:1918] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:46:38.332283 11865 log.cc:1196] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/e2d34de8287142c5b68739db6ca5caf2
I20260812 02:46:38.332521 11865 ts_tablet_manager.cc:1939] T e2d34de8287142c5b68739db6ca5caf2 P 51b2ad244dff434ea9f0adf71772e033: Deleting consensus metadata
I20260812 02:46:38.333360 11867 ts_tablet_manager.cc:1918] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:46:38.333482 11867 log.cc:1196] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/e2d34de8287142c5b68739db6ca5caf2
I20260812 02:46:38.333654 10939 catalog_manager.cc:4841] TS 51b2ad244dff434ea9f0adf71772e033 (127.10.75.66:37197): tablet e2d34de8287142c5b68739db6ca5caf2 (table test-table [id=5214d62475d94601be2ec4a732eb559d]) successfully deleted
I20260812 02:46:38.333823 11867 ts_tablet_manager.cc:1939] T e2d34de8287142c5b68739db6ca5caf2 P bcfb07284e404cf09f25d132a7974ebd: Deleting consensus metadata
I20260812 02:46:38.335034 10937 catalog_manager.cc:4841] TS bcfb07284e404cf09f25d132a7974ebd (127.10.75.67:43927): tablet e2d34de8287142c5b68739db6ca5caf2 (table test-table [id=5214d62475d94601be2ec4a732eb559d]) successfully deleted
W20260812 02:46:38.336277 10933 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.75.65:34609 (error 108)
I20260812 02:46:38.336488 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 11302
I20260812 02:46:38.349442 11803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:38.349050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:34609 (local address 127.0.0.1:46440)
0812 02:46:38.349236 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:38.349327 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.65:34609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260812 02:46:38.349665 10933 catalog_manager.cc:4584] TS 61da7a6fd4e3489e84e3d8ba1492943b (127.10.75.65:34609): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e2d34de8287142c5b68739db6ca5caf2: Network error: Client connection negotiation failed: client connection to 127.10.75.65:34609: connect: Connection refused (error 111)
I20260812 02:46:38.354743 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 11540
I20260812 02:46:38.369429 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 10896
2026-08-12T02:46:38Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1222 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:46:38 dist-test-slave-2p8l krb5kdc[11871](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:46:38 dist-test-slave-2p8l krb5kdc[11871](info): set up 2 sockets
Aug 12 02:46:38 dist-test-slave-2p8l krb5kdc[11871](info): commencing operation
krb5kdc: starting...
W20260812 02:46:39.749600 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.351s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:46:39 dist-test-slave-2p8l krb5kdc[11871](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502799, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:46:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:46:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:46:39.881883 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:46493
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:39515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:46493
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:39.996635 11898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:39.996929 11898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:39.997033 11898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:40.001190 11898 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:46:40.001259 11898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:40.001281 11898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:40.001297 11898 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:46:40.001312 11898 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:46:40.006816 11898 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:39515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:46493
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:46493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:40.007992 11898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:40.009052 11898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 02:46:40.017999 11898 server_base.cc:1034] running on GCE node
W20260812 02:46:40.017838 11904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:40.017825 11903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:40.017841 11909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:40.018749 11898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:40.019867 11898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:40.021044 11898 hybrid_clock.cc:648] HybridClock initialized: now 1786502800021032 us; error 30 us; skew 500 ppm
Aug 12 02:46:40 dist-test-slave-2p8l krb5kdc[11871](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502800, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:40.024068 11898 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:46:40.025008 11898 webserver.cc:460] Webserver started at http://127.10.75.126:35395/ using document root <none> and password file <none>
I20260812 02:46:40.025591 11898 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:40.025658 11898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:40.025904 11898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:40.028086 11898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "8521b3edfa25447a80fa7b9747c763d0"
format_stamp: "Formatted at 2026-08-12 02:46:40 on dist-test-slave-2p8l"
server_key: "a781d2c7b2128ad3cad555906313748b"
server_key_iv: "a6dd95fdd73635080caf30494f3f3294"
server_key_version: "encryptionkey@0"
I20260812 02:46:40.028738 11898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "8521b3edfa25447a80fa7b9747c763d0"
format_stamp: "Formatted at 2026-08-12 02:46:40 on dist-test-slave-2p8l"
server_key: "a781d2c7b2128ad3cad555906313748b"
server_key_iv: "a6dd95fdd73635080caf30494f3f3294"
server_key_version: "encryptionkey@0"
I20260812 02:46:40.032820 11898 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 02:46:40.035497 11916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:40.036841 11898 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:46:40.036988 11898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "8521b3edfa25447a80fa7b9747c763d0"
format_stamp: "Formatted at 2026-08-12 02:46:40 on dist-test-slave-2p8l"
server_key: "a781d2c7b2128ad3cad555906313748b"
server_key_iv: "a6dd95fdd73635080caf30494f3f3294"
server_key_version: "encryptionkey@0"
I20260812 02:46:40.037123 11898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:40.061939 11898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:40.065492 11898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:40.065706 11898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:40.073419 11898 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:46493
I20260812 02:46:40.073452 12011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:46493 every 8 connection(s)
I20260812 02:46:40.074499 11898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:46:40.077353 12012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:40.079002 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 11898
I20260812 02:46:40.079147 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:46:40.079445 10541 external_mini_cluster.cc:1428] Setting key 8dabf8ed9838a0f9e0ff7fba49395ea1
I20260812 02:46:40.083750 12012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0: Bootstrap starting.
I20260812 02:46:40.085968 12012 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:40.086720 12012 log.cc:824] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0: Log is configured to *not* fsync() on all Append() calls
Aug 12 02:46:40 dist-test-slave-2p8l krb5kdc[11871](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502799, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:46:40.088884 12012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0: No bootstrap required, opened a new log
I20260812 02:46:40.093720 12012 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8521b3edfa25447a80fa7b9747c763d0" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 46493 } }
I20260812 02:46:40.094003 12012 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:40.095022 12016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:40.080930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54766 (local address 127.10.75.126:46493)
0812 02:46:40.081385 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:40.081400 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:40.081436 (+ 36us) server_negotiation.cc:407] Connection header received
0812 02:46:40.082211 (+ 775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:40.082230 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:40.082558 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:40.082879 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:40.083714 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.084760 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.085618 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.086130 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.086321 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:40.089475 (+ 3154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:40.089481 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:40.089498 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:40.089538 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:40.091670 (+ 2132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:40.092154 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:40.092160 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:40.092167 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:40.092305 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:40.092605 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:40.092608 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:40.092610 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:40.093144 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:40.093344 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:40.093618 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 02:46:40.093913 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":142,"threads_started":1}
I20260812 02:46:40.100457 12012 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8521b3edfa25447a80fa7b9747c763d0, State: Initialized, Role: FOLLOWER
I20260812 02:46:40.101001 12012 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8521b3edfa25447a80fa7b9747c763d0" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 46493 } }
I20260812 02:46:40.101191 12012 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:46:40.101254 12012 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:46:40.101347 12012 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:40.102644 12012 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8521b3edfa25447a80fa7b9747c763d0" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 46493 } }
I20260812 02:46:40.103091 12012 leader_election.cc:302] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8521b3edfa25447a80fa7b9747c763d0; no voters:
I20260812 02:46:40.103493 12012 leader_election.cc:288] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:46:40.103607 12018 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:40.103849 12018 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0 [term 1 LEADER]: Becoming Leader. State: Replica: 8521b3edfa25447a80fa7b9747c763d0, State: Running, Role: LEADER
I20260812 02:46:40.104159 12018 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8521b3edfa25447a80fa7b9747c763d0" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 46493 } }
I20260812 02:46:40.104728 12012 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:46:40.105883 12022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8521b3edfa25447a80fa7b9747c763d0. Latest consensus state: current_term: 1 leader_uuid: "8521b3edfa25447a80fa7b9747c763d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8521b3edfa25447a80fa7b9747c763d0" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 46493 } } }
I20260812 02:46:40.105870 12021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8521b3edfa25447a80fa7b9747c763d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8521b3edfa25447a80fa7b9747c763d0" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 46493 } } }
I20260812 02:46:40.106020 12022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0 [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:40.106020 12021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0 [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:40.106495 12033 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:46:40.109659 12033 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:46:40.116236 12033 catalog_manager.cc:1347] Generated new cluster ID: 0d6922a6df244f2c9b85b1e6c4ff4151
I20260812 02:46:40.116317 12033 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:46:40.139358 12033 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:46:40.140439 12033 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:46:40.147789 12033 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0: Generated new TSK 0
I20260812 02:46:40.148444 12033 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
I20260812 02:46:40.185684 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:46493
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:39515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:40.300112 12058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:40.300350 12058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:40.300391 12058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:40.304518 12058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:40.304579 12058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:40.304642 12058 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:46:40.310230 12058 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:39515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:46493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:40.311164 12058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:40.312172 12058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:40.321290 12065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:40.321306 12064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:40.321288 12069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:40.321748 12058 server_base.cc:1034] running on GCE node
I20260812 02:46:40.322219 12058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:40.322836 12058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:40.324028 12058 hybrid_clock.cc:648] HybridClock initialized: now 1786502800324001 us; error 48 us; skew 500 ppm
Aug 12 02:46:40 dist-test-slave-2p8l krb5kdc[11871](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502800, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:40.326830 12058 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:46:40.327683 12058 webserver.cc:460] Webserver started at http://127.10.75.65:35359/ using document root <none> and password file <none>
I20260812 02:46:40.328229 12058 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:40.328321 12058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:40.328553 12058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:40.330590 12058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "9aa87426a39946809d4d95fdd0a675e2"
format_stamp: "Formatted at 2026-08-12 02:46:40 on dist-test-slave-2p8l"
server_key: "f32e698e8f4768f46a29ffb05032f574"
server_key_iv: "c6ae3f4c15abcd7024255e038bddc440"
server_key_version: "encryptionkey@0"
I20260812 02:46:40.331197 12058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "9aa87426a39946809d4d95fdd0a675e2"
format_stamp: "Formatted at 2026-08-12 02:46:40 on dist-test-slave-2p8l"
server_key: "f32e698e8f4768f46a29ffb05032f574"
server_key_iv: "c6ae3f4c15abcd7024255e038bddc440"
server_key_version: "encryptionkey@0"
I20260812 02:46:40.335107 12058 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 02:46:40.337553 12085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:40.338838 12058 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 02:46:40.338980 12058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "9aa87426a39946809d4d95fdd0a675e2"
format_stamp: "Formatted at 2026-08-12 02:46:40 on dist-test-slave-2p8l"
server_key: "f32e698e8f4768f46a29ffb05032f574"
server_key_iv: "c6ae3f4c15abcd7024255e038bddc440"
server_key_version: "encryptionkey@0"
I20260812 02:46:40.339093 12058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:40.359196 12058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:40.362640 12058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:40.362851 12058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:40.363448 12058 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:40.364283 12058 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:40.364354 12058 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:40.364426 12058 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:40.364470 12058 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:40.374300 12058 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:34121
I20260812 02:46:40.374332 12295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:34121 every 8 connection(s)
I20260812 02:46:40.375188 12058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:46:40.383141 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 12058
I20260812 02:46:40.383307 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:46:40.383641 10541 external_mini_cluster.cc:1428] Setting key d90443a4a56d42de4003d59a7a18df5e
Aug 12 02:46:40 dist-test-slave-2p8l krb5kdc[11871](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502800, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:46:40.388944 12016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:40.376978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:47455 (local address 127.10.75.126:46493)
0812 02:46:40.377115 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:40.377118 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:40.377975 (+ 857us) server_negotiation.cc:407] Connection header received
0812 02:46:40.379272 (+ 1297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:40.379275 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:40.379322 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:40.379399 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:40.380464 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.381005 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.382114 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.382339 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.382419 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:40.385179 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:40.385183 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:40.385186 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:40.385219 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:40.386708 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:40.387368 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:40.387374 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:40.387381 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:40.387464 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:40.387820 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:40.387824 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:40.387826 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:40.388013 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:40.388131 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:40.388638 (+ 507us) server_negotiation.cc:299] Negotiation successful
0812 02:46:40.388773 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 02:46:40.389793 12303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:40.377341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:46493 (local address 127.10.75.65:47455)
0812 02:46:40.377821 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:40.377864 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:40.379072 (+ 1208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:40.379521 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:40.379527 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:40.379877 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:40.380326 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:40.380340 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.381128 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.381130 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:40.381971 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:40.381981 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.382470 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.382472 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:40.382604 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:40.383298 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:46:40.383322 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:40.384990 (+ 1668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:40.386828 (+ 1838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:40.386837 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:40.386854 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:40.387254 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:40.387571 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:40.387574 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:40.387576 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:40.387717 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:40.388130 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:40.388136 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:40.388370 (+ 234us) client_negotiation.cc:769] Sending connection context
0812 02:46:40.388561 (+ 191us) client_negotiation.cc:240] Negotiation successful
0812 02:46:40.388881 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":135,"threads_started":1}
I20260812 02:46:40.391279 12296 heartbeater.cc:347] Connected to a master server at 127.10.75.126:46493
I20260812 02:46:40.391527 12296 heartbeater.cc:464] Registering TS with master...
I20260812 02:46:40.392032 12296 heartbeater.cc:511] Master 127.10.75.126:46493 requested a full tablet report, sending...
I20260812 02:46:40.393597 11942 ts_manager.cc:194] Registered new tserver with Master: 9aa87426a39946809d4d95fdd0a675e2 (127.10.75.65:34121)
WARNING: no policy specified for kudu/127.10.75.66@KRBTEST.COM; defaulting to no policy
I20260812 02:46:40.394860 11942 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:47455
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
I20260812 02:46:40.415378 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:46493
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:39515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:40.548991 12311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:40.549275 12311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:40.549348 12311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:40.553567 12311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:40.553669 12311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:40.553759 12311 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:46:40.559073 12311 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:39515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:46493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12311
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:40.560133 12311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:40.561188 12311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:40.570812 12325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:40.570827 12311 server_base.cc:1034] running on GCE node
W20260812 02:46:40.570815 12326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:40.570855 12328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:40.571570 12311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:40.572207 12311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:40.573348 12311 hybrid_clock.cc:648] HybridClock initialized: now 1786502800573322 us; error 40 us; skew 500 ppm
Aug 12 02:46:40 dist-test-slave-2p8l krb5kdc[11871](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502800, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:40.576117 12311 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:46:40.576953 12311 webserver.cc:460] Webserver started at http://127.10.75.66:45127/ using document root <none> and password file <none>
I20260812 02:46:40.577450 12311 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:40.577508 12311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:40.577673 12311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:40.579659 12311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "44a01d4eb33b439494a5a4cb3b763c54"
format_stamp: "Formatted at 2026-08-12 02:46:40 on dist-test-slave-2p8l"
server_key: "deeaffd1bc9711dd4d3df87c72e2a6f4"
server_key_iv: "16c5187c4ac1d7474c328aa747c3e919"
server_key_version: "encryptionkey@0"
I20260812 02:46:40.580158 12311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "44a01d4eb33b439494a5a4cb3b763c54"
format_stamp: "Formatted at 2026-08-12 02:46:40 on dist-test-slave-2p8l"
server_key: "deeaffd1bc9711dd4d3df87c72e2a6f4"
server_key_iv: "16c5187c4ac1d7474c328aa747c3e919"
server_key_version: "encryptionkey@0"
I20260812 02:46:40.583737 12311 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260812 02:46:40.586027 12337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:40.587261 12311 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:46:40.587361 12311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "44a01d4eb33b439494a5a4cb3b763c54"
format_stamp: "Formatted at 2026-08-12 02:46:40 on dist-test-slave-2p8l"
server_key: "deeaffd1bc9711dd4d3df87c72e2a6f4"
server_key_iv: "16c5187c4ac1d7474c328aa747c3e919"
server_key_version: "encryptionkey@0"
I20260812 02:46:40.587447 12311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:40.596737 12311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:40.599469 12311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:40.599680 12311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:40.600252 12311 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:40.601049 12311 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:40.601096 12311 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:40.601167 12311 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:40.601200 12311 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:40.610671 12311 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:42029
I20260812 02:46:40.610749 12547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:42029 every 8 connection(s)
I20260812 02:46:40.611547 12311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:46:40.614938 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 12311
I20260812 02:46:40.615080 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:46:40.615360 10541 external_mini_cluster.cc:1428] Setting key f4c0d5fb96bd3bf76717d25658c88cde
Aug 12 02:46:40 dist-test-slave-2p8l krb5kdc[11871](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502800, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.75.67@KRBTEST.COM; defaulting to no policy
I20260812 02:46:40.625533 12016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:40.613417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:46415 (local address 127.10.75.126:46493)
0812 02:46:40.613556 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:40.613559 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:40.614416 (+ 857us) server_negotiation.cc:407] Connection header received
0812 02:46:40.615853 (+ 1437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:40.615857 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:40.615915 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:40.615993 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:40.617460 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.617988 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.619155 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.619386 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.619504 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:40.621912 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:40.621916 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:40.621919 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:40.621949 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:40.623475 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:40.623985 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:40.623989 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:40.623991 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:40.624075 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:40.624419 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:40.624423 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:40.624425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:40.624628 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:40.624740 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:40.625232 (+ 492us) server_negotiation.cc:299] Negotiation successful
0812 02:46:40.625359 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 02:46:40.626410 12552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:40.613781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:46493 (local address 127.10.75.66:46415)
0812 02:46:40.614268 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:40.614311 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:40.615643 (+ 1332us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:40.616159 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:40.616167 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:40.616712 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:40.617310 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:40.617324 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.618167 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.618170 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:40.619020 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:40.619029 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.619544 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.619548 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:40.619718 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:40.620319 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:46:40.620335 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:40.621748 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:40.623609 (+ 1861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:40.623615 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:40.623629 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:40.623877 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:40.624178 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:40.624182 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:40.624184 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:40.624320 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:40.624739 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:40.624746 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:40.624982 (+ 236us) client_negotiation.cc:769] Sending connection context
0812 02:46:40.625173 (+ 191us) client_negotiation.cc:240] Negotiation successful
0812 02:46:40.625482 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":116,"threads_started":1}
I20260812 02:46:40.627548 12549 heartbeater.cc:347] Connected to a master server at 127.10.75.126:46493
I20260812 02:46:40.627804 12549 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.67@KRBTEST.COM" created.
I20260812 02:46:40.628381 12549 heartbeater.cc:511] Master 127.10.75.126:46493 requested a full tablet report, sending...
I20260812 02:46:40.629503 11942 ts_manager.cc:194] Registered new tserver with Master: 44a01d4eb33b439494a5a4cb3b763c54 (127.10.75.66:42029)
I20260812 02:46:40.630151 11942 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:46415
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
I20260812 02:46:40.644837 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:46493
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:39515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:40.756771 12556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:40.757020 12556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:40.757062 12556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:40.761185 12556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:40.761241 12556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:40.761323 12556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:46:40.766645 12556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:39515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:46493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:40.767692 12556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:40.768718 12556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:40.778144 12569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:40.778182 12566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:40.778182 12567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:40.778311 12556 server_base.cc:1034] running on GCE node
I20260812 02:46:40.778774 12556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:40.779403 12556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:40.780566 12556 hybrid_clock.cc:648] HybridClock initialized: now 1786502800780554 us; error 26 us; skew 500 ppm
Aug 12 02:46:40 dist-test-slave-2p8l krb5kdc[11871](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502800, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:40.783535 12556 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:46:40.784344 12556 webserver.cc:460] Webserver started at http://127.10.75.67:43251/ using document root <none> and password file <none>
I20260812 02:46:40.784873 12556 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:40.784932 12556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:40.785102 12556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:40.787106 12556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "988d269b2e78447d8ac6e53f6da47856"
format_stamp: "Formatted at 2026-08-12 02:46:40 on dist-test-slave-2p8l"
server_key: "5451168bc59bc52e769df54339b60a7c"
server_key_iv: "1ce280bd14982ffa64ad1ac19f1142a1"
server_key_version: "encryptionkey@0"
I20260812 02:46:40.787633 12556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "988d269b2e78447d8ac6e53f6da47856"
format_stamp: "Formatted at 2026-08-12 02:46:40 on dist-test-slave-2p8l"
server_key: "5451168bc59bc52e769df54339b60a7c"
server_key_iv: "1ce280bd14982ffa64ad1ac19f1142a1"
server_key_version: "encryptionkey@0"
I20260812 02:46:40.791319 12556 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260812 02:46:40.793548 12581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:40.794791 12556 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:46:40.794888 12556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "988d269b2e78447d8ac6e53f6da47856"
format_stamp: "Formatted at 2026-08-12 02:46:40 on dist-test-slave-2p8l"
server_key: "5451168bc59bc52e769df54339b60a7c"
server_key_iv: "1ce280bd14982ffa64ad1ac19f1142a1"
server_key_version: "encryptionkey@0"
I20260812 02:46:40.794970 12556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:40.812492 12556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:40.815361 12556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:40.815508 12556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:40.816037 12556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:40.816794 12556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:40.816841 12556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:40.816882 12556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:40.816903 12556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:40.825712 12556 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:44399
I20260812 02:46:40.825740 12782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:44399 every 8 connection(s)
I20260812 02:46:40.826649 12556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:46:40.831610 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 12556
I20260812 02:46:40.831781 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:46:40.832137 10541 external_mini_cluster.cc:1428] Setting key 7e7b3ca1efb1ef045cb7df69139c2056
Aug 12 02:46:40 dist-test-slave-2p8l krb5kdc[11871](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502800, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:46:40.840444 12016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:40.828491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:58439 (local address 127.10.75.126:46493)
0812 02:46:40.828648 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:40.828652 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:40.829429 (+ 777us) server_negotiation.cc:407] Connection header received
0812 02:46:40.830857 (+ 1428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:40.830861 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:40.830923 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:40.831027 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:40.832319 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.833084 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.834560 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.834775 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.834859 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:40.837259 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:40.837262 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:40.837265 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:40.837290 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:40.838619 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:40.839072 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:40.839075 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:40.839076 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:40.839167 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:40.839464 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:40.839466 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:40.839467 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:40.839641 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:40.839720 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:40.840229 (+ 509us) server_negotiation.cc:299] Negotiation successful
0812 02:46:40.840328 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 02:46:40.841337 12787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:40.828805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:46493 (local address 127.10.75.67:58439)
0812 02:46:40.829280 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:40.829321 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:40.830635 (+ 1314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:40.831204 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:40.831211 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:40.831556 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:40.832139 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:40.832153 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.833237 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.833242 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:40.834436 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:40.834447 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.834908 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.834910 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:40.835049 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:40.835659 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:46:40.835675 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:40.837103 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:40.838723 (+ 1620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:40.838727 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:40.838739 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:40.838979 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:40.839251 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:40.839254 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:40.839255 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:40.839381 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:40.839764 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:40.839769 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:40.840001 (+ 232us) client_negotiation.cc:769] Sending connection context
0812 02:46:40.840183 (+ 182us) client_negotiation.cc:240] Negotiation successful
0812 02:46:40.840529 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":136,"threads_started":1}
I20260812 02:46:40.842533 12784 heartbeater.cc:347] Connected to a master server at 127.10.75.126:46493
I20260812 02:46:40.842739 12784 heartbeater.cc:464] Registering TS with master...
I20260812 02:46:40.843190 12784 heartbeater.cc:511] Master 127.10.75.126:46493 requested a full tablet report, sending...
I20260812 02:46:40.844215 11942 ts_manager.cc:194] Registered new tserver with Master: 988d269b2e78447d8ac6e53f6da47856 (127.10.75.67:44399)
I20260812 02:46:40.844918 11942 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:58439
I20260812 02:46:40.846114 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:46:40.855958 12016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:40.848049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54776 (local address 127.10.75.126:46493)
0812 02:46:40.848194 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:40.848199 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:40.848378 (+ 179us) server_negotiation.cc:407] Connection header received
0812 02:46:40.848524 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:40.848527 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:40.848567 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:40.848666 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:40.849346 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.849842 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.850747 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.850975 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.851087 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:40.852686 (+ 1599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:40.852690 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:40.852692 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:40.852717 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:40.854363 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:40.854847 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:40.854849 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:40.854850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:40.854918 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:40.855202 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:40.855204 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:40.855205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:40.855381 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:40.855494 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:40.855776 (+ 282us) server_negotiation.cc:299] Negotiation successful
0812 02:46:40.855850 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 02:46:40.858805 11942 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54776:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:46:40.861698 11942 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:46:40.877038 12804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:40.870465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:34121 (local address 127.0.0.1:42730)
0812 02:46:40.871154 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:40.871207 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:40.871335 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:40.872388 (+ 1053us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:40.872392 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:40.872414 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:40.872556 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:40.872565 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.874346 (+ 1781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.874349 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:40.875559 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:40.875569 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.876628 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.876631 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:40.876745 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:40.876768 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 02:46:40.876846 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 02:46:40.876903 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":130,"thread_start_us":98,"threads_started":1}
I20260812 02:46:40.877166 12816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:40.871358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42730 (local address 127.10.75.65:34121)
0812 02:46:40.871814 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:40.871833 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:40.871860 (+ 27us) server_negotiation.cc:407] Connection header received
0812 02:46:40.871946 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:40.871954 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:40.872209 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:40.872717 (+ 508us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:40.872883 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.874168 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.875696 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.876492 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.876614 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:40.876769 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:40.876898 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 02:46:40.877005 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":132,"threads_started":1}
I20260812 02:46:40.877417 12812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:40.870727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39108 (local address 127.10.75.67:44399)
0812 02:46:40.871307 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:40.871319 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:40.871878 (+ 559us) server_negotiation.cc:407] Connection header received
0812 02:46:40.871967 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:40.871972 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:40.872156 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:40.872315 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:40.872636 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.873456 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.875147 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.876081 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.876217 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:40.876368 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:40.877126 (+ 758us) server_negotiation.cc:299] Negotiation successful
0812 02:46:40.877247 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":134,"threads_started":1}
I20260812 02:46:40.877048 12813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:40.870593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:44399 (local address 127.0.0.1:39108)
0812 02:46:40.871574 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:40.871589 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:40.871683 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:40.872306 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:40.872312 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:40.872333 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:40.872486 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:40.872492 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.873593 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.873603 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:40.874988 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:40.875000 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.876430 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.876433 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:40.876527 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:40.876592 (+ 65us) client_negotiation.cc:769] Sending connection context
0812 02:46:40.876709 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 02:46:40.876854 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":917,"mutex_wait_us":37,"thread_start_us":86,"threads_started":1}
I20260812 02:46:40.877830 12806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:40.871237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:42029 (local address 127.0.0.1:50788)
0812 02:46:40.871867 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:40.871881 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:40.871959 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:40.872622 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:40.872625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:40.872652 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:40.872731 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:40.872737 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.874345 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.874349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:40.875787 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:40.875800 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.877097 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.877101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:40.877211 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:40.877514 (+ 303us) client_negotiation.cc:769] Sending connection context
0812 02:46:40.877596 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 02:46:40.877698 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"mutex_wait_us":124,"thread_start_us":105,"threads_started":1}
I20260812 02:46:40.878404 12821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:40.871694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50788 (local address 127.10.75.66:42029)
0812 02:46:40.872135 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:40.872147 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:40.872170 (+ 23us) server_negotiation.cc:407] Connection header received
0812 02:46:40.872246 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:40.872250 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:40.872427 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:40.872656 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:40.872820 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.874168 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.875939 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:40.876768 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:40.876900 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:40.877029 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:40.878096 (+ 1067us) server_negotiation.cc:299] Negotiation successful
0812 02:46:40.878237 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":103,"threads_started":1}
I20260812 02:46:40.880540 12668 tablet_service.cc:1467] Processing CreateTablet for tablet 25e8cf3024804a999b3ec083f41dd169 (DEFAULT_TABLE table=test-table [id=52a94fce3f7e4cb2814744db660e07ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:46:40.881585 12668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25e8cf3024804a999b3ec083f41dd169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:40.881213 12432 tablet_service.cc:1467] Processing CreateTablet for tablet 25e8cf3024804a999b3ec083f41dd169 (DEFAULT_TABLE table=test-table [id=52a94fce3f7e4cb2814744db660e07ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:46:40.881219 12171 tablet_service.cc:1467] Processing CreateTablet for tablet 25e8cf3024804a999b3ec083f41dd169 (DEFAULT_TABLE table=test-table [id=52a94fce3f7e4cb2814744db660e07ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:46:40.882371 12432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25e8cf3024804a999b3ec083f41dd169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:40.882371 12171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25e8cf3024804a999b3ec083f41dd169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:40.887614 12822 tablet_bootstrap.cc:492] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856: Bootstrap starting.
I20260812 02:46:40.890038 12822 tablet_bootstrap.cc:654] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:40.890224 12824 tablet_bootstrap.cc:492] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54: Bootstrap starting.
I20260812 02:46:40.890714 12823 tablet_bootstrap.cc:492] T 25e8cf3024804a999b3ec083f41dd169 P 9aa87426a39946809d4d95fdd0a675e2: Bootstrap starting.
I20260812 02:46:40.892117 12822 log.cc:824] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:40.893038 12823 tablet_bootstrap.cc:654] T 25e8cf3024804a999b3ec083f41dd169 P 9aa87426a39946809d4d95fdd0a675e2: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:40.893934 12823 log.cc:824] T 25e8cf3024804a999b3ec083f41dd169 P 9aa87426a39946809d4d95fdd0a675e2: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:40.894457 12822 tablet_bootstrap.cc:492] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856: No bootstrap required, opened a new log
I20260812 02:46:40.894686 12822 ts_tablet_manager.cc:1397] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260812 02:46:40.895015 12824 tablet_bootstrap.cc:654] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:40.895678 12824 log.cc:824] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:40.897348 12823 tablet_bootstrap.cc:492] T 25e8cf3024804a999b3ec083f41dd169 P 9aa87426a39946809d4d95fdd0a675e2: No bootstrap required, opened a new log
I20260812 02:46:40.897570 12823 ts_tablet_manager.cc:1397] T 25e8cf3024804a999b3ec083f41dd169 P 9aa87426a39946809d4d95fdd0a675e2: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260812 02:46:40.897622 12824 tablet_bootstrap.cc:492] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54: No bootstrap required, opened a new log
I20260812 02:46:40.897810 12824 ts_tablet_manager.cc:1397] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260812 02:46:40.898295 12822 raft_consensus.cc:348] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa87426a39946809d4d95fdd0a675e2" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34121 } } peers { permanent_uuid: "988d269b2e78447d8ac6e53f6da47856" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44399 } } peers { permanent_uuid: "44a01d4eb33b439494a5a4cb3b763c54" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42029 } }
I20260812 02:46:40.898598 12822 raft_consensus.cc:374] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:40.898663 12822 raft_consensus.cc:729] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 988d269b2e78447d8ac6e53f6da47856, State: Initialized, Role: FOLLOWER
I20260812 02:46:40.899127 12822 consensus_queue.cc:260] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa87426a39946809d4d95fdd0a675e2" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34121 } } peers { permanent_uuid: "988d269b2e78447d8ac6e53f6da47856" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44399 } } peers { permanent_uuid: "44a01d4eb33b439494a5a4cb3b763c54" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42029 } }
I20260812 02:46:40.900180 12822 ts_tablet_manager.cc:1428] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 02:46:40.900555 12784 heartbeater.cc:503] Master 127.10.75.126:46493 was elected leader, sending a full tablet report...
I20260812 02:46:40.901594 12823 raft_consensus.cc:348] T 25e8cf3024804a999b3ec083f41dd169 P 9aa87426a39946809d4d95fdd0a675e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa87426a39946809d4d95fdd0a675e2" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34121 } } peers { permanent_uuid: "988d269b2e78447d8ac6e53f6da47856" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44399 } } peers { permanent_uuid: "44a01d4eb33b439494a5a4cb3b763c54" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42029 } }
I20260812 02:46:40.901597 12824 raft_consensus.cc:348] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa87426a39946809d4d95fdd0a675e2" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34121 } } peers { permanent_uuid: "988d269b2e78447d8ac6e53f6da47856" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44399 } } peers { permanent_uuid: "44a01d4eb33b439494a5a4cb3b763c54" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42029 } }
I20260812 02:46:40.901875 12823 raft_consensus.cc:374] T 25e8cf3024804a999b3ec083f41dd169 P 9aa87426a39946809d4d95fdd0a675e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:40.901883 12824 raft_consensus.cc:374] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:40.901928 12824 raft_consensus.cc:729] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a01d4eb33b439494a5a4cb3b763c54, State: Initialized, Role: FOLLOWER
I20260812 02:46:40.901928 12823 raft_consensus.cc:729] T 25e8cf3024804a999b3ec083f41dd169 P 9aa87426a39946809d4d95fdd0a675e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa87426a39946809d4d95fdd0a675e2, State: Initialized, Role: FOLLOWER
I20260812 02:46:40.902359 12824 consensus_queue.cc:260] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa87426a39946809d4d95fdd0a675e2" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34121 } } peers { permanent_uuid: "988d269b2e78447d8ac6e53f6da47856" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44399 } } peers { permanent_uuid: "44a01d4eb33b439494a5a4cb3b763c54" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42029 } }
I20260812 02:46:40.902397 12823 consensus_queue.cc:260] T 25e8cf3024804a999b3ec083f41dd169 P 9aa87426a39946809d4d95fdd0a675e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa87426a39946809d4d95fdd0a675e2" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34121 } } peers { permanent_uuid: "988d269b2e78447d8ac6e53f6da47856" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44399 } } peers { permanent_uuid: "44a01d4eb33b439494a5a4cb3b763c54" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42029 } }
I20260812 02:46:40.902997 12549 heartbeater.cc:503] Master 127.10.75.126:46493 was elected leader, sending a full tablet report...
I20260812 02:46:40.903349 12824 ts_tablet_manager.cc:1428] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 02:46:40.903373 12823 ts_tablet_manager.cc:1428] T 25e8cf3024804a999b3ec083f41dd169 P 9aa87426a39946809d4d95fdd0a675e2: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 02:46:40.903705 12296 heartbeater.cc:503] Master 127.10.75.126:46493 was elected leader, sending a full tablet report...
W20260812 02:46:41.077629 12786 tablet.cc:2369] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:46:41.097206 12833 raft_consensus.cc:482] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:46:41.097424 12833 raft_consensus.cc:504] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa87426a39946809d4d95fdd0a675e2" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34121 } } peers { permanent_uuid: "988d269b2e78447d8ac6e53f6da47856" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44399 } } peers { permanent_uuid: "44a01d4eb33b439494a5a4cb3b763c54" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42029 } }
I20260812 02:46:41.098773 12833 leader_election.cc:288] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9aa87426a39946809d4d95fdd0a675e2 (127.10.75.65:34121), 988d269b2e78447d8ac6e53f6da47856 (127.10.75.67:44399)
I20260812 02:46:41.103976 12816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:41.099175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:51241 (local address 127.10.75.65:34121)
0812 02:46:41.099312 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:41.099318 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:41.099584 (+ 266us) server_negotiation.cc:407] Connection header received
0812 02:46:41.099661 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:41.099665 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:41.099722 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:41.099808 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:41.100043 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.100885 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.102627 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.103237 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.103365 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:41.103422 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:41.103760 (+ 338us) server_negotiation.cc:299] Negotiation successful
0812 02:46:41.103844 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 02:46:41.103976 12812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:41.099280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:33397 (local address 127.10.75.67:44399)
0812 02:46:41.099442 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:41.099447 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:41.099600 (+ 153us) server_negotiation.cc:407] Connection header received
0812 02:46:41.099685 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:41.099688 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:41.099734 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:41.099806 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:41.100221 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.100930 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.102627 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.103237 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.103365 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:41.103422 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:41.103760 (+ 338us) server_negotiation.cc:299] Negotiation successful
0812 02:46:41.103840 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 02:46:41.104077 12552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:41.099064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:34121 (local address 127.10.75.66:51241)
0812 02:46:41.099290 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:41.099306 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:41.099423 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:41.099823 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:41.099825 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:41.099840 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:41.099937 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:41.099941 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.101028 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.101031 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:41.102492 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:41.102503 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.103366 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.103370 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:41.103588 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:41.103647 (+ 59us) client_negotiation.cc:769] Sending connection context
0812 02:46:41.103720 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 02:46:41.103899 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":212}
I20260812 02:46:41.104288 12835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:41.099064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:44399 (local address 127.10.75.66:33397)
0812 02:46:41.099491 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:41.099503 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:41.099604 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:41.100029 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:41.100030 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:41.100040 (+ 10us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:41.100120 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:41.100123 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.101029 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.101031 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:41.102492 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:41.102503 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.103366 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.103370 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:41.103592 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:41.103634 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 02:46:41.103720 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 02:46:41.103899 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"mutex_wait_us":236,"thread_start_us":108,"threads_started":1}
I20260812 02:46:41.104946 12202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25e8cf3024804a999b3ec083f41dd169" candidate_uuid: "44a01d4eb33b439494a5a4cb3b763c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa87426a39946809d4d95fdd0a675e2" is_pre_election: true
I20260812 02:46:41.105036 12706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25e8cf3024804a999b3ec083f41dd169" candidate_uuid: "44a01d4eb33b439494a5a4cb3b763c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "988d269b2e78447d8ac6e53f6da47856" is_pre_election: true
I20260812 02:46:41.105299 12202 raft_consensus.cc:2454] T 25e8cf3024804a999b3ec083f41dd169 P 9aa87426a39946809d4d95fdd0a675e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a01d4eb33b439494a5a4cb3b763c54 in term 0.
I20260812 02:46:41.105379 12706 raft_consensus.cc:2454] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a01d4eb33b439494a5a4cb3b763c54 in term 0.
I20260812 02:46:41.105933 12346 leader_election.cc:302] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a01d4eb33b439494a5a4cb3b763c54, 9aa87426a39946809d4d95fdd0a675e2; no voters:
I20260812 02:46:41.106249 12833 raft_consensus.cc:2781] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:46:41.106343 12833 raft_consensus.cc:482] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:46:41.106388 12833 raft_consensus.cc:3037] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:41.107434 12833 raft_consensus.cc:504] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa87426a39946809d4d95fdd0a675e2" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34121 } } peers { permanent_uuid: "988d269b2e78447d8ac6e53f6da47856" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44399 } } peers { permanent_uuid: "44a01d4eb33b439494a5a4cb3b763c54" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42029 } }
I20260812 02:46:41.107798 12833 leader_election.cc:288] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [CANDIDATE]: Term 1 election: Requested vote from peers 9aa87426a39946809d4d95fdd0a675e2 (127.10.75.65:34121), 988d269b2e78447d8ac6e53f6da47856 (127.10.75.67:44399)
I20260812 02:46:41.108261 12202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25e8cf3024804a999b3ec083f41dd169" candidate_uuid: "44a01d4eb33b439494a5a4cb3b763c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa87426a39946809d4d95fdd0a675e2"
I20260812 02:46:41.108418 12202 raft_consensus.cc:3037] T 25e8cf3024804a999b3ec083f41dd169 P 9aa87426a39946809d4d95fdd0a675e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:41.108418 12706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25e8cf3024804a999b3ec083f41dd169" candidate_uuid: "44a01d4eb33b439494a5a4cb3b763c54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "988d269b2e78447d8ac6e53f6da47856"
I20260812 02:46:41.108574 12706 raft_consensus.cc:3037] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:41.109570 12202 raft_consensus.cc:2454] T 25e8cf3024804a999b3ec083f41dd169 P 9aa87426a39946809d4d95fdd0a675e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a01d4eb33b439494a5a4cb3b763c54 in term 1.
I20260812 02:46:41.109882 12706 raft_consensus.cc:2454] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a01d4eb33b439494a5a4cb3b763c54 in term 1.
I20260812 02:46:41.109891 12346 leader_election.cc:302] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a01d4eb33b439494a5a4cb3b763c54, 9aa87426a39946809d4d95fdd0a675e2; no voters:
I20260812 02:46:41.110078 12833 raft_consensus.cc:2781] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:41.110318 12833 raft_consensus.cc:686] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [term 1 LEADER]: Becoming Leader. State: Replica: 44a01d4eb33b439494a5a4cb3b763c54, State: Running, Role: LEADER
I20260812 02:46:41.110646 12833 consensus_queue.cc:237] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa87426a39946809d4d95fdd0a675e2" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34121 } } peers { permanent_uuid: "988d269b2e78447d8ac6e53f6da47856" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44399 } } peers { permanent_uuid: "44a01d4eb33b439494a5a4cb3b763c54" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42029 } }
W20260812 02:46:41.112636 12551 tablet.cc:2369] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:46:41.113806 11942 catalog_manager.cc:5495] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a01d4eb33b439494a5a4cb3b763c54 (127.10.75.66). New cstate: current_term: 1 leader_uuid: "44a01d4eb33b439494a5a4cb3b763c54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa87426a39946809d4d95fdd0a675e2" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "988d269b2e78447d8ac6e53f6da47856" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a01d4eb33b439494a5a4cb3b763c54" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42029 } health_report { overall_health: HEALTHY } } }
W20260812 02:46:41.126504 12301 tablet.cc:2369] T 25e8cf3024804a999b3ec083f41dd169 P 9aa87426a39946809d4d95fdd0a675e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:46:41.176194 12821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:41.172394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50796 (local address 127.10.75.66:42029)
0812 02:46:41.172539 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:41.172543 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:41.172557 (+ 14us) server_negotiation.cc:407] Connection header received
0812 02:46:41.172662 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:41.172665 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:41.172721 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:41.172811 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:46:41.173091 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.173633 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.174589 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.174799 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.174892 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:41.175285 (+ 393us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:46:41.175685 (+ 400us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:46:41.175801 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:41.175929 (+ 128us) server_negotiation.cc:299] Negotiation successful
0812 02:46:41.176004 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 02:46:41.181813 12202 raft_consensus.cc:1261] T 25e8cf3024804a999b3ec083f41dd169 P 9aa87426a39946809d4d95fdd0a675e2 [term 1 FOLLOWER]: Refusing update from remote peer 44a01d4eb33b439494a5a4cb3b763c54: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:46:41.181813 12706 raft_consensus.cc:1261] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856 [term 1 FOLLOWER]: Refusing update from remote peer 44a01d4eb33b439494a5a4cb3b763c54: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:46:41.182621 12836 consensus_queue.cc:1035] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa87426a39946809d4d95fdd0a675e2" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 34121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:46:41.182934 12833 consensus_queue.cc:1035] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "988d269b2e78447d8ac6e53f6da47856" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:46:41.200290 11942 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:46:41.200444 11942 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:46:41.202951 11942 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8521b3edfa25447a80fa7b9747c763d0: Sending DeleteTablet for 3 replicas of tablet 25e8cf3024804a999b3ec083f41dd169
I20260812 02:46:41.203795 12171 tablet_service.cc:1514] Processing DeleteTablet for tablet 25e8cf3024804a999b3ec083f41dd169 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:46:41 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:42730
I20260812 02:46:41.203802 12668 tablet_service.cc:1514] Processing DeleteTablet for tablet 25e8cf3024804a999b3ec083f41dd169 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:46:41 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:39108
I20260812 02:46:41.204326 12859 tablet_replica.cc:330] T 25e8cf3024804a999b3ec083f41dd169 P 9aa87426a39946809d4d95fdd0a675e2: stopping tablet replica
I20260812 02:46:41.204685 12859 raft_consensus.cc:2229] T 25e8cf3024804a999b3ec083f41dd169 P 9aa87426a39946809d4d95fdd0a675e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:46:41.204726 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 12058
I20260812 02:46:41.205030 12859 raft_consensus.cc:2258] T 25e8cf3024804a999b3ec083f41dd169 P 9aa87426a39946809d4d95fdd0a675e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:46:41.204757 12858 tablet_replica.cc:330] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856: stopping tablet replica
I20260812 02:46:41.208551 12858 raft_consensus.cc:2229] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:46:41.208854 12858 raft_consensus.cc:2258] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:46:41.211476 12858 ts_tablet_manager.cc:1905] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:46:41.214001 12858 ts_tablet_manager.cc:1918] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:46:41.214145 12858 log.cc:1196] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/25e8cf3024804a999b3ec083f41dd169
I20260812 02:46:41.214480 12858 ts_tablet_manager.cc:1939] T 25e8cf3024804a999b3ec083f41dd169 P 988d269b2e78447d8ac6e53f6da47856: Deleting consensus metadata
I20260812 02:46:41.216435 11920 catalog_manager.cc:4841] TS 988d269b2e78447d8ac6e53f6da47856 (127.10.75.67:44399): tablet 25e8cf3024804a999b3ec083f41dd169 (table test-table [id=52a94fce3f7e4cb2814744db660e07ef]) successfully deleted
I20260812 02:46:41.225621 12432 tablet_service.cc:1514] Processing DeleteTablet for tablet 25e8cf3024804a999b3ec083f41dd169 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:46:41 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:50788
I20260812 02:46:41.226399 12860 tablet_replica.cc:330] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54: stopping tablet replica
I20260812 02:46:41.226750 12860 raft_consensus.cc:2229] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:46:41.227174 12860 raft_consensus.cc:2258] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:46:41.228444 12860 ts_tablet_manager.cc:1905] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:46:41.230749 12860 ts_tablet_manager.cc:1918] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:46:41.230870 12860 log.cc:1196] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/25e8cf3024804a999b3ec083f41dd169
I20260812 02:46:41.231195 12860 ts_tablet_manager.cc:1939] T 25e8cf3024804a999b3ec083f41dd169 P 44a01d4eb33b439494a5a4cb3b763c54: Deleting consensus metadata
I20260812 02:46:41.232327 11920 catalog_manager.cc:4841] TS 44a01d4eb33b439494a5a4cb3b763c54 (127.10.75.66:42029): tablet 25e8cf3024804a999b3ec083f41dd169 (table test-table [id=52a94fce3f7e4cb2814744db660e07ef]) successfully deleted
W20260812 02:46:41.233806 11922 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.75.65:34121 (error 108)
I20260812 02:46:41.234108 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 12311
I20260812 02:46:41.247563 12806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:41.247257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:34121 (local address 127.0.0.1:42742)
0812 02:46:41.247395 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:41.247482 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.65:34121: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 02:46:41.247757 11922 catalog_manager.cc:4584] TS 9aa87426a39946809d4d95fdd0a675e2 (127.10.75.65:34121): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 25e8cf3024804a999b3ec083f41dd169: Network error: Client connection negotiation failed: client connection to 127.10.75.65:34121: connect: Connection refused (error 111)
I20260812 02:46:41.252314 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 12556
I20260812 02:46:41.263223 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 11898
2026-08-12T02:46:41Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2892 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T02:46:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:46:41Z Disabled control of system clock
I20260812 02:46:41.300655 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:43787
--webserver_interface=127.10.75.126
--webserver_port=0
--builtin_ntp_servers=127.10.75.84:41667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:43787
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 02:46:41.411849 12868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:41.412106 12868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:41.412147 12868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:41.416100 12868 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:46:41.416160 12868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:41.416177 12868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:41.416193 12868 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:46:41.416209 12868 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:46:41.420854 12868 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:41667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:43787
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:43787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:41.421856 12868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:41.423193 12868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:41.431659 12879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:41.431634 12880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:41.431805 12868 server_base.cc:1034] running on GCE node
W20260812 02:46:41.431977 12886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:41.432489 12868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:41.433532 12868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:41.434702 12868 hybrid_clock.cc:648] HybridClock initialized: now 1786502801434678 us; error 46 us; skew 500 ppm
I20260812 02:46:41.439728 12868 webserver.cc:460] Webserver started at http://127.10.75.126:35829/ using document root <none> and password file <none>
I20260812 02:46:41.440310 12868 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:41.440372 12868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:41.440582 12868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:41.442688 12868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "48d9c3ba50894dd19ea621959e653f07"
format_stamp: "Formatted at 2026-08-12 02:46:41 on dist-test-slave-2p8l"
server_key: "3d95fc61bc05fb75a0007de4473298c9"
server_key_iv: "5d343bbd3b66a49c5f796225e92b874c"
server_key_version: "encryptionkey@0"
I20260812 02:46:41.443257 12868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "48d9c3ba50894dd19ea621959e653f07"
format_stamp: "Formatted at 2026-08-12 02:46:41 on dist-test-slave-2p8l"
server_key: "3d95fc61bc05fb75a0007de4473298c9"
server_key_iv: "5d343bbd3b66a49c5f796225e92b874c"
server_key_version: "encryptionkey@0"
I20260812 02:46:41.446985 12868 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 02:46:41.449301 12896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:41.450584 12868 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:46:41.450721 12868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "48d9c3ba50894dd19ea621959e653f07"
format_stamp: "Formatted at 2026-08-12 02:46:41 on dist-test-slave-2p8l"
server_key: "3d95fc61bc05fb75a0007de4473298c9"
server_key_iv: "5d343bbd3b66a49c5f796225e92b874c"
server_key_version: "encryptionkey@0"
I20260812 02:46:41.450829 12868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:41.485836 12868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:41.486723 12868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:41.486949 12868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:41.494625 12868 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:43787
I20260812 02:46:41.494894 12980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:43787 every 8 connection(s)
I20260812 02:46:41.495657 12868 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:46:41.496728 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 12868
I20260812 02:46:41.496877 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:46:41.497169 10541 external_mini_cluster.cc:1428] Setting key 17bfd64b962fd15f8a2a57ce6d18b2e3
I20260812 02:46:41.499300 12981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:41.505900 12981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07: Bootstrap starting.
I20260812 02:46:41.506512 12986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:41.498669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53944 (local address 127.10.75.126:43787)
0812 02:46:41.499290 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:41.499306 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:41.499340 (+ 34us) server_negotiation.cc:407] Connection header received
0812 02:46:41.500033 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:41.500049 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:41.500420 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:41.500700 (+ 280us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:41.501035 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.501990 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.503259 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.503722 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.503845 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:41.504763 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:41.504768 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:41.504779 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:41.505145 (+ 366us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:41.505197 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:41.505217 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:41.505292 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:41.505471 (+ 179us) server_negotiation.cc:299] Negotiation successful
0812 02:46:41.505770 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":149,"threads_started":1}
I20260812 02:46:41.508538 12981 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:41.509300 12981 log.cc:824] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:41.511224 12981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07: No bootstrap required, opened a new log
I20260812 02:46:41.514792 12981 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48d9c3ba50894dd19ea621959e653f07" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43787 } }
I20260812 02:46:41.514995 12981 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:41.515084 12981 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d9c3ba50894dd19ea621959e653f07, State: Initialized, Role: FOLLOWER
I20260812 02:46:41.515494 12981 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48d9c3ba50894dd19ea621959e653f07" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43787 } }
I20260812 02:46:41.515646 12981 raft_consensus.cc:388] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:46:41.515730 12981 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:46:41.515844 12981 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:41.516726 12981 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48d9c3ba50894dd19ea621959e653f07" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43787 } }
I20260812 02:46:41.517052 12981 leader_election.cc:302] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48d9c3ba50894dd19ea621959e653f07; no voters:
I20260812 02:46:41.517344 12981 leader_election.cc:288] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:46:41.517465 12995 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:41.517697 12995 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07 [term 1 LEADER]: Becoming Leader. State: Replica: 48d9c3ba50894dd19ea621959e653f07, State: Running, Role: LEADER
I20260812 02:46:41.518014 12995 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48d9c3ba50894dd19ea621959e653f07" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43787 } }
I20260812 02:46:41.518730 12981 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:46:41.519747 12996 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48d9c3ba50894dd19ea621959e653f07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48d9c3ba50894dd19ea621959e653f07" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43787 } } }
I20260812 02:46:41.519884 12996 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07 [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:41.520210 12997 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48d9c3ba50894dd19ea621959e653f07. Latest consensus state: current_term: 1 leader_uuid: "48d9c3ba50894dd19ea621959e653f07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48d9c3ba50894dd19ea621959e653f07" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43787 } } }
I20260812 02:46:41.520308 12997 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07 [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:41.520396 13011 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:46:41.523079 13011 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:46:41.528437 13011 catalog_manager.cc:1347] Generated new cluster ID: 6c228eaf340949d6b94e1045a97f8292
I20260812 02:46:41.528520 13011 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:46:41.543577 13011 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:46:41.544740 13011 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:46:41.556949 13011 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07: Generated new TSK 0
I20260812 02:46:41.557616 13011 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:46:41.561546 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43787
--builtin_ntp_servers=127.10.75.84:41667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 02:46:41.680817 13026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:41.681058 13026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:41.681098 13026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:41.685081 13026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:41.685134 13026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:41.685225 13026 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:46:41.689862 13026 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:41667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:41.690966 13026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:41.692385 13026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:41.702035 13037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:41.702018 13041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:41.701996 13036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:41.702289 13026 server_base.cc:1034] running on GCE node
I20260812 02:46:41.702695 13026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:41.703361 13026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:41.704572 13026 hybrid_clock.cc:648] HybridClock initialized: now 1786502801704547 us; error 33 us; skew 500 ppm
I20260812 02:46:41.706491 13026 webserver.cc:460] Webserver started at http://127.10.75.65:43157/ using document root <none> and password file <none>
I20260812 02:46:41.707069 13026 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:41.707165 13026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:41.707398 13026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:41.709414 13026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "4046956b7fb7467092ada13b054b3eab"
format_stamp: "Formatted at 2026-08-12 02:46:41 on dist-test-slave-2p8l"
server_key: "faf2f98aafa2436a34cb681337096d3b"
server_key_iv: "239b3843e231f5aa8341d9e670c221c1"
server_key_version: "encryptionkey@0"
I20260812 02:46:41.710001 13026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "4046956b7fb7467092ada13b054b3eab"
format_stamp: "Formatted at 2026-08-12 02:46:41 on dist-test-slave-2p8l"
server_key: "faf2f98aafa2436a34cb681337096d3b"
server_key_iv: "239b3843e231f5aa8341d9e670c221c1"
server_key_version: "encryptionkey@0"
I20260812 02:46:41.713795 13026 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 02:46:41.716312 13053 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:41.717479 13026 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:46:41.717626 13026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "4046956b7fb7467092ada13b054b3eab"
format_stamp: "Formatted at 2026-08-12 02:46:41 on dist-test-slave-2p8l"
server_key: "faf2f98aafa2436a34cb681337096d3b"
server_key_iv: "239b3843e231f5aa8341d9e670c221c1"
server_key_version: "encryptionkey@0"
I20260812 02:46:41.717746 13026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:41.737151 13026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:41.737922 13026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:41.738179 13026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:41.738880 13026 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:41.739845 13026 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:41.739894 13026 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:41.739933 13026 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:41.739949 13026 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:41.748790 13026 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:41267
I20260812 02:46:41.748829 13252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:41267 every 8 connection(s)
I20260812 02:46:41.749675 13026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:46:41.759670 12986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:41.751593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:35331 (local address 127.10.75.126:43787)
0812 02:46:41.751763 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:41.751767 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:41.752894 (+ 1127us) server_negotiation.cc:407] Connection header received
0812 02:46:41.754415 (+ 1521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:41.754418 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:41.754469 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:41.754571 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:41.755632 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.756178 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.757507 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.757737 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.757824 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:41.758970 (+ 1146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:41.758973 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:41.758975 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:41.758988 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:41.759007 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:41.759015 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:41.759086 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:41.759327 (+ 241us) server_negotiation.cc:299] Negotiation successful
0812 02:46:41.759404 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 02:46:41.759785 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 13026
I20260812 02:46:41.759920 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:46:41.760239 10541 external_mini_cluster.cc:1428] Setting key d0d8d3a0858869401ee142391d234711
I20260812 02:46:41.760497 13256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:41.752048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:43787 (local address 127.10.75.65:35331)
0812 02:46:41.752739 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:41.752779 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:41.754205 (+ 1426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:41.754767 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:41.754774 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:41.754856 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:41.755458 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:41.755473 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.756301 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.756304 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:41.757366 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:41.757378 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.757884 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.757886 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:41.758028 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:41.758707 (+ 679us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:46:41.758708 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:41.758748 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:46:41.758814 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:41.759156 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:41.759165 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:41.759171 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 02:46:41.759292 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 02:46:41.759526 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":120,"threads_started":1}
I20260812 02:46:41.761997 13253 heartbeater.cc:347] Connected to a master server at 127.10.75.126:43787
I20260812 02:46:41.762297 13253 heartbeater.cc:464] Registering TS with master...
I20260812 02:46:41.762444 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43787
--builtin_ntp_servers=127.10.75.84:41667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 02:46:41.762956 13253 heartbeater.cc:511] Master 127.10.75.126:43787 requested a full tablet report, sending...
I20260812 02:46:41.764645 12921 ts_manager.cc:194] Registered new tserver with Master: 4046956b7fb7467092ada13b054b3eab (127.10.75.65:41267)
I20260812 02:46:41.765801 12921 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.75.65:35331
W20260812 02:46:41.883104 13258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:41.883374 13258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:41.883416 13258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:41.887948 13258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:41.888010 13258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:41.888072 13258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:46:41.893356 13258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:41667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13258
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:41.894543 13258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:41.896049 13258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:41.906596 13276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:41.906699 13258 server_base.cc:1034] running on GCE node
W20260812 02:46:41.906747 13266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:41.906616 13268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:41.907271 13258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:41.907970 13258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:41.909193 13258 hybrid_clock.cc:648] HybridClock initialized: now 1786502801909171 us; error 35 us; skew 500 ppm
I20260812 02:46:41.912091 13258 webserver.cc:460] Webserver started at http://127.10.75.66:43847/ using document root <none> and password file <none>
I20260812 02:46:41.912918 13258 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:41.913045 13258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:41.913306 13258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:41.915642 13258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "3cb26394a9b84baa8b9fa8019f86c67a"
format_stamp: "Formatted at 2026-08-12 02:46:41 on dist-test-slave-2p8l"
server_key: "978e0f866632600e87683fe4f4232893"
server_key_iv: "e2849ead316f8fa92e90192880895c20"
server_key_version: "encryptionkey@0"
I20260812 02:46:41.916280 13258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "3cb26394a9b84baa8b9fa8019f86c67a"
format_stamp: "Formatted at 2026-08-12 02:46:41 on dist-test-slave-2p8l"
server_key: "978e0f866632600e87683fe4f4232893"
server_key_iv: "e2849ead316f8fa92e90192880895c20"
server_key_version: "encryptionkey@0"
I20260812 02:46:41.920497 13258 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 02:46:41.923637 13290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:41.925047 13258 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 02:46:41.925230 13258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "3cb26394a9b84baa8b9fa8019f86c67a"
format_stamp: "Formatted at 2026-08-12 02:46:41 on dist-test-slave-2p8l"
server_key: "978e0f866632600e87683fe4f4232893"
server_key_iv: "e2849ead316f8fa92e90192880895c20"
server_key_version: "encryptionkey@0"
I20260812 02:46:41.925370 13258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:41.941816 13258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:41.942625 13258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:41.942844 13258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:41.943490 13258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:41.944532 13258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:41.944612 13258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:41.944690 13258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:41.944739 13258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:41.954605 13258 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:42757
I20260812 02:46:41.954628 13490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:42757 every 8 connection(s)
I20260812 02:46:41.955559 13258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:46:41.960940 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 13258
I20260812 02:46:41.961099 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:46:41.961426 10541 external_mini_cluster.cc:1428] Setting key bda425ac4c184a24ad4215cede0902b9
I20260812 02:46:41.963595 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43787
--builtin_ntp_servers=127.10.75.84:41667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 02:46:41.965472 12986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:41.957433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:41715 (local address 127.10.75.126:43787)
0812 02:46:41.957573 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:41.957577 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:41.958861 (+ 1284us) server_negotiation.cc:407] Connection header received
0812 02:46:41.960281 (+ 1420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:41.960284 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:41.960345 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:41.960456 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:41.961440 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.962156 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.963456 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.963695 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.963811 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:41.964964 (+ 1153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:41.964967 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:41.964970 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:41.964983 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:41.965010 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:41.965018 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:41.965096 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:41.965261 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 02:46:41.965329 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 02:46:41.966401 13494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:41.957914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:43787 (local address 127.10.75.66:41715)
0812 02:46:41.958719 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:41.958760 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:41.960056 (+ 1296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:41.960639 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:41.960645 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:41.960727 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:41.961290 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:41.961306 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.962292 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.962296 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:41.963328 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:41.963339 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:41.963855 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:41.963859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:41.964022 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:41.964687 (+ 665us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:46:41.964688 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:41.964728 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:46:41.964793 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:41.965100 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:41.965113 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:41.965119 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 02:46:41.965260 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 02:46:41.965540 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":227,"threads_started":1}
I20260812 02:46:41.967612 13491 heartbeater.cc:347] Connected to a master server at 127.10.75.126:43787
I20260812 02:46:41.967870 13491 heartbeater.cc:464] Registering TS with master...
I20260812 02:46:41.968389 13491 heartbeater.cc:511] Master 127.10.75.126:43787 requested a full tablet report, sending...
I20260812 02:46:41.969501 12921 ts_manager.cc:194] Registered new tserver with Master: 3cb26394a9b84baa8b9fa8019f86c67a (127.10.75.66:42757)
I20260812 02:46:41.970207 12921 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.75.66:41715
W20260812 02:46:42.079178 13495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:42.079480 13495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:42.079556 13495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:42.083573 13495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:42.083660 13495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:42.083755 13495 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:46:42.089221 13495 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:41667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:43787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:42.090348 13495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:42.091722 13495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 02:46:42.101610 13495 server_base.cc:1034] running on GCE node
W20260812 02:46:42.101531 13502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:42.101526 13506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:42.101562 13509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:42.102288 13495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:42.102923 13495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:42.104118 13495 hybrid_clock.cc:648] HybridClock initialized: now 1786502802104088 us; error 43 us; skew 500 ppm
I20260812 02:46:42.106211 13495 webserver.cc:460] Webserver started at http://127.10.75.67:46495/ using document root <none> and password file <none>
I20260812 02:46:42.106866 13495 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:42.106973 13495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:42.107198 13495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:42.109252 13495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "baf2fe8a1cdb4f00b6581482ff5cd44f"
format_stamp: "Formatted at 2026-08-12 02:46:42 on dist-test-slave-2p8l"
server_key: "f7a347b5ef19563273a0e8ea68f04e2d"
server_key_iv: "5929be16e1fc680528a796968db4c67e"
server_key_version: "encryptionkey@0"
I20260812 02:46:42.109836 13495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "baf2fe8a1cdb4f00b6581482ff5cd44f"
format_stamp: "Formatted at 2026-08-12 02:46:42 on dist-test-slave-2p8l"
server_key: "f7a347b5ef19563273a0e8ea68f04e2d"
server_key_iv: "5929be16e1fc680528a796968db4c67e"
server_key_version: "encryptionkey@0"
I20260812 02:46:42.113616 13495 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20260812 02:46:42.116187 13520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:42.117365 13495 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:46:42.117517 13495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "baf2fe8a1cdb4f00b6581482ff5cd44f"
format_stamp: "Formatted at 2026-08-12 02:46:42 on dist-test-slave-2p8l"
server_key: "f7a347b5ef19563273a0e8ea68f04e2d"
server_key_iv: "5929be16e1fc680528a796968db4c67e"
server_key_version: "encryptionkey@0"
I20260812 02:46:42.117666 13495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:42.128474 13495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:42.129149 13495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:42.129340 13495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:42.129959 13495 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:42.130934 13495 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:42.131007 13495 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:42.131083 13495 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:42.131127 13495 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:42.140280 13495 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:38999
I20260812 02:46:42.140308 13722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:38999 every 8 connection(s)
I20260812 02:46:42.141136 13495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:46:42.141512 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 13495
I20260812 02:46:42.141649 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:46:42.141978 10541 external_mini_cluster.cc:1428] Setting key dd896d9fc5337c18598ac2c042da6407
I20260812 02:46:42.150843 12986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:42.143265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:48313 (local address 127.10.75.126:43787)
0812 02:46:42.143463 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:42.143470 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:42.144772 (+ 1302us) server_negotiation.cc:407] Connection header received
0812 02:46:42.146193 (+ 1421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:42.146196 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:42.146253 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:42.146359 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:42.147222 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.147756 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.148887 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.149109 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.149222 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:42.150349 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:42.150357 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:42.150359 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:42.150370 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:42.150388 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:42.150396 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:42.150478 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:42.150643 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 02:46:42.150704 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260812 02:46:42.151674 13726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:42.143781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:43787 (local address 127.10.75.67:48313)
0812 02:46:42.144630 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:42.144671 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:42.145944 (+ 1273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:42.146535 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:42.146542 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:42.146619 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:42.147074 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:42.147087 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.147897 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.147901 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:42.148753 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:42.148762 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.149261 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.149265 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:42.149429 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:42.150034 (+ 605us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:46:42.150035 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:42.150125 (+ 90us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:46:42.150198 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:42.150485 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:42.150496 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:42.150502 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 02:46:42.150636 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 02:46:42.150895 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":136,"threads_started":1}
I20260812 02:46:42.152841 13723 heartbeater.cc:347] Connected to a master server at 127.10.75.126:43787
I20260812 02:46:42.153043 13723 heartbeater.cc:464] Registering TS with master...
I20260812 02:46:42.153530 13723 heartbeater.cc:511] Master 127.10.75.126:43787 requested a full tablet report, sending...
I20260812 02:46:42.154628 12921 ts_manager.cc:194] Registered new tserver with Master: baf2fe8a1cdb4f00b6581482ff5cd44f (127.10.75.67:38999)
I20260812 02:46:42.155413 12921 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.75.67:48313
I20260812 02:46:42.156343 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:46:42.161734 12986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:42.158329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53958 (local address 127.10.75.126:43787)
0812 02:46:42.158438 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:42.158442 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:42.158617 (+ 175us) server_negotiation.cc:407] Connection header received
0812 02:46:42.158697 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:42.158699 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:42.158735 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:42.158802 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:42.159039 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.159508 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.160320 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.160527 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.160648 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:42.161373 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:42.161376 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:42.161378 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:42.161388 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:42.161405 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:42.161412 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:42.161511 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:42.161611 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 02:46:42.161640 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 02:46:42.164528 12921 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53958:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:46:42.167428 12921 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:46:42.181198 13746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:42.175765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:41267 (local address 127.0.0.1:54234)
0812 02:46:42.176132 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:42.176192 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:42.176324 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:42.177224 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:42.177231 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:42.177259 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:42.177403 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:42.177415 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.178726 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.178732 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:42.179863 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:42.179875 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.180675 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.180679 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:42.180786 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:42.180824 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 02:46:42.180923 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 02:46:42.181053 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":109,"threads_started":1}
I20260812 02:46:42.181208 13747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:42.175962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54234 (local address 127.10.75.65:41267)
0812 02:46:42.176707 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:42.176720 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:42.176750 (+ 30us) server_negotiation.cc:407] Connection header received
0812 02:46:42.176832 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:42.176839 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:42.177045 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:42.177239 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:42.177562 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.178616 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.180002 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.180549 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.180675 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:42.180882 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:42.180951 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 02:46:42.181042 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":110,"threads_started":1}
I20260812 02:46:42.182713 13757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:42.176566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41962 (local address 127.10.75.67:38999)
0812 02:46:42.177229 (+ 663us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:42.177240 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:42.177398 (+ 158us) server_negotiation.cc:407] Connection header received
0812 02:46:42.177637 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:42.177643 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:42.177815 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:42.177953 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:42.178342 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.179430 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.181213 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.182006 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.182123 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:42.182281 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:42.182431 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 02:46:42.182526 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":149,"threads_started":1}
I20260812 02:46:42.183144 13756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:42.176156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:38999 (local address 127.0.0.1:41962)
0812 02:46:42.177300 (+ 1144us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:42.177314 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:42.177471 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:42.178120 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:42.178123 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:42.178141 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:42.178220 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:42.178226 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.179555 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.179558 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:42.181052 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:42.181064 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.182194 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.182198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:42.182286 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:42.182308 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 02:46:42.182942 (+ 634us) client_negotiation.cc:240] Negotiation successful
0812 02:46:42.183017 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1080,"mutex_wait_us":172,"thread_start_us":104,"threads_started":1}
I20260812 02:46:42.183604 13754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:42.176475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:42757 (local address 127.0.0.1:51322)
0812 02:46:42.177378 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:42.177391 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:42.177485 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:42.177935 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:42.177938 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:42.177956 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:42.178078 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:42.178090 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.179555 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.179558 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:42.181052 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:42.181064 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.183177 (+ 2113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.183181 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:42.183368 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:42.183389 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 02:46:42.183456 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 02:46:42.183507 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":840,"mutex_wait_us":144,"thread_start_us":100,"threads_started":1}
I20260812 02:46:42.183777 13758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:42.176913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51322 (local address 127.10.75.66:42757)
0812 02:46:42.177571 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:42.177584 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:42.177605 (+ 21us) server_negotiation.cc:407] Connection header received
0812 02:46:42.177677 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:42.177680 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:42.177806 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:42.177957 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:42.178215 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.179411 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.181217 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.182612 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.182720 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:42.183097 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:42.183524 (+ 427us) server_negotiation.cc:299] Negotiation successful
0812 02:46:42.183626 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":121,"threads_started":1}
I20260812 02:46:42.184244 13135 tablet_service.cc:1467] Processing CreateTablet for tablet ef935c6a7c344ce8b8c7e75fa24de86e (DEFAULT_TABLE table=test-table [id=a1b1ff0153ff473fa4810b8eea87f3db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:46:42.185160 13135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef935c6a7c344ce8b8c7e75fa24de86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:42.188898 13373 tablet_service.cc:1467] Processing CreateTablet for tablet ef935c6a7c344ce8b8c7e75fa24de86e (DEFAULT_TABLE table=test-table [id=a1b1ff0153ff473fa4810b8eea87f3db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:46:42.188839 13593 tablet_service.cc:1467] Processing CreateTablet for tablet ef935c6a7c344ce8b8c7e75fa24de86e (DEFAULT_TABLE table=test-table [id=a1b1ff0153ff473fa4810b8eea87f3db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:46:42.189764 13373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef935c6a7c344ce8b8c7e75fa24de86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:42.189848 13593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef935c6a7c344ce8b8c7e75fa24de86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:42.192456 13759 tablet_bootstrap.cc:492] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab: Bootstrap starting.
I20260812 02:46:42.195042 13759 tablet_bootstrap.cc:654] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:42.195932 13759 log.cc:824] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:42.196312 13761 tablet_bootstrap.cc:492] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f: Bootstrap starting.
I20260812 02:46:42.197465 13762 tablet_bootstrap.cc:492] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a: Bootstrap starting.
I20260812 02:46:42.198161 13761 tablet_bootstrap.cc:654] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:42.198654 13759 tablet_bootstrap.cc:492] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab: No bootstrap required, opened a new log
I20260812 02:46:42.198843 13759 ts_tablet_manager.cc:1397] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 02:46:42.198874 13761 log.cc:824] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:42.199517 13762 tablet_bootstrap.cc:654] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:42.200289 13762 log.cc:824] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:42.201018 13761 tablet_bootstrap.cc:492] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f: No bootstrap required, opened a new log
I20260812 02:46:42.201211 13761 ts_tablet_manager.cc:1397] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260812 02:46:42.202220 13762 tablet_bootstrap.cc:492] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a: No bootstrap required, opened a new log
I20260812 02:46:42.202400 13762 ts_tablet_manager.cc:1397] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 02:46:42.203198 13759 raft_consensus.cc:348] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046956b7fb7467092ada13b054b3eab" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41267 } } peers { permanent_uuid: "3cb26394a9b84baa8b9fa8019f86c67a" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42757 } } peers { permanent_uuid: "baf2fe8a1cdb4f00b6581482ff5cd44f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 38999 } }
I20260812 02:46:42.203461 13759 raft_consensus.cc:374] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:42.203531 13759 raft_consensus.cc:729] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4046956b7fb7467092ada13b054b3eab, State: Initialized, Role: FOLLOWER
I20260812 02:46:42.203979 13759 consensus_queue.cc:260] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046956b7fb7467092ada13b054b3eab" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41267 } } peers { permanent_uuid: "3cb26394a9b84baa8b9fa8019f86c67a" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42757 } } peers { permanent_uuid: "baf2fe8a1cdb4f00b6581482ff5cd44f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 38999 } }
I20260812 02:46:42.204646 13253 heartbeater.cc:503] Master 127.10.75.126:43787 was elected leader, sending a full tablet report...
I20260812 02:46:42.204767 13761 raft_consensus.cc:348] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046956b7fb7467092ada13b054b3eab" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41267 } } peers { permanent_uuid: "3cb26394a9b84baa8b9fa8019f86c67a" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42757 } } peers { permanent_uuid: "baf2fe8a1cdb4f00b6581482ff5cd44f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 38999 } }
I20260812 02:46:42.204989 13761 raft_consensus.cc:374] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:42.205057 13761 raft_consensus.cc:729] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baf2fe8a1cdb4f00b6581482ff5cd44f, State: Initialized, Role: FOLLOWER
I20260812 02:46:42.205462 13761 consensus_queue.cc:260] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046956b7fb7467092ada13b054b3eab" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41267 } } peers { permanent_uuid: "3cb26394a9b84baa8b9fa8019f86c67a" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42757 } } peers { permanent_uuid: "baf2fe8a1cdb4f00b6581482ff5cd44f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 38999 } }
I20260812 02:46:42.206137 13759 ts_tablet_manager.cc:1428] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 02:46:42.206431 13761 ts_tablet_manager.cc:1428] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260812 02:46:42.206384 13762 raft_consensus.cc:348] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046956b7fb7467092ada13b054b3eab" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41267 } } peers { permanent_uuid: "3cb26394a9b84baa8b9fa8019f86c67a" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42757 } } peers { permanent_uuid: "baf2fe8a1cdb4f00b6581482ff5cd44f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 38999 } }
I20260812 02:46:42.206550 13762 raft_consensus.cc:374] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:42.206588 13762 raft_consensus.cc:729] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb26394a9b84baa8b9fa8019f86c67a, State: Initialized, Role: FOLLOWER
I20260812 02:46:42.206779 13723 heartbeater.cc:503] Master 127.10.75.126:43787 was elected leader, sending a full tablet report...
I20260812 02:46:42.207027 13762 consensus_queue.cc:260] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046956b7fb7467092ada13b054b3eab" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41267 } } peers { permanent_uuid: "3cb26394a9b84baa8b9fa8019f86c67a" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42757 } } peers { permanent_uuid: "baf2fe8a1cdb4f00b6581482ff5cd44f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 38999 } }
I20260812 02:46:42.207938 13762 ts_tablet_manager.cc:1428] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 02:46:42.208276 13491 heartbeater.cc:503] Master 127.10.75.126:43787 was elected leader, sending a full tablet report...
I20260812 02:46:42.222198 13768 raft_consensus.cc:482] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:46:42.222386 13768 raft_consensus.cc:504] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046956b7fb7467092ada13b054b3eab" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41267 } } peers { permanent_uuid: "3cb26394a9b84baa8b9fa8019f86c67a" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42757 } } peers { permanent_uuid: "baf2fe8a1cdb4f00b6581482ff5cd44f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 38999 } }
I20260812 02:46:42.223428 13768 leader_election.cc:288] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb26394a9b84baa8b9fa8019f86c67a (127.10.75.66:42757), baf2fe8a1cdb4f00b6581482ff5cd44f (127.10.75.67:38999)
I20260812 02:46:42.227489 13256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:42.223671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:42757 (local address 127.10.75.65:45123)
0812 02:46:42.223829 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:42.223842 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:42.223947 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:42.224222 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:42.224225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:42.224243 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:42.224388 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:42.224397 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.225254 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.225258 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:42.226359 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:42.226369 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.227047 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.227051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:42.227162 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:42.227197 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 02:46:42.227270 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 02:46:42.227351 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260812 02:46:42.227510 13758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:42.223825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:45123 (local address 127.10.75.66:42757)
0812 02:46:42.223992 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:42.223998 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:42.224015 (+ 17us) server_negotiation.cc:407] Connection header received
0812 02:46:42.224065 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:42.224070 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:42.224117 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:42.224193 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:42.224523 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.225148 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.226491 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.226932 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.227022 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:42.227067 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:42.227295 (+ 228us) server_negotiation.cc:299] Negotiation successful
0812 02:46:42.227367 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 02:46:42.227671 13774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:42.223672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:38999 (local address 127.10.75.65:33513)
0812 02:46:42.224218 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:42.224231 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:42.224321 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:42.224604 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:42.224607 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:42.224626 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:42.224738 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:42.224744 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.225493 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.225495 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:42.226537 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:42.226548 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.227231 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.227234 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:42.227348 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:42.227372 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 02:46:42.227454 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 02:46:42.227514 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":199,"thread_start_us":93,"threads_started":1}
I20260812 02:46:42.227700 13757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:42.223732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:33513 (local address 127.10.75.67:38999)
0812 02:46:42.223845 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:42.223851 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:42.224311 (+ 460us) server_negotiation.cc:407] Connection header received
0812 02:46:42.224418 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:42.224424 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:42.224479 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:42.224567 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:42.224848 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.225379 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.226669 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.227102 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.227227 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:42.227287 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:42.227489 (+ 202us) server_negotiation.cc:299] Negotiation successful
0812 02:46:42.227566 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 02:46:42.228188 13405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef935c6a7c344ce8b8c7e75fa24de86e" candidate_uuid: "4046956b7fb7467092ada13b054b3eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb26394a9b84baa8b9fa8019f86c67a" is_pre_election: true
I20260812 02:46:42.228190 13635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef935c6a7c344ce8b8c7e75fa24de86e" candidate_uuid: "4046956b7fb7467092ada13b054b3eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baf2fe8a1cdb4f00b6581482ff5cd44f" is_pre_election: true
I20260812 02:46:42.228441 13635 raft_consensus.cc:2454] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4046956b7fb7467092ada13b054b3eab in term 0.
I20260812 02:46:42.228446 13405 raft_consensus.cc:2454] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4046956b7fb7467092ada13b054b3eab in term 0.
I20260812 02:46:42.228904 13054 leader_election.cc:302] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4046956b7fb7467092ada13b054b3eab, baf2fe8a1cdb4f00b6581482ff5cd44f; no voters:
I20260812 02:46:42.229171 13768 raft_consensus.cc:2781] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:46:42.229269 13768 raft_consensus.cc:482] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:46:42.229328 13768 raft_consensus.cc:3037] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:42.230470 13768 raft_consensus.cc:504] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046956b7fb7467092ada13b054b3eab" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41267 } } peers { permanent_uuid: "3cb26394a9b84baa8b9fa8019f86c67a" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42757 } } peers { permanent_uuid: "baf2fe8a1cdb4f00b6581482ff5cd44f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 38999 } }
I20260812 02:46:42.230803 13768 leader_election.cc:288] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab [CANDIDATE]: Term 1 election: Requested vote from peers 3cb26394a9b84baa8b9fa8019f86c67a (127.10.75.66:42757), baf2fe8a1cdb4f00b6581482ff5cd44f (127.10.75.67:38999)
I20260812 02:46:42.231158 13405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef935c6a7c344ce8b8c7e75fa24de86e" candidate_uuid: "4046956b7fb7467092ada13b054b3eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb26394a9b84baa8b9fa8019f86c67a"
I20260812 02:46:42.231158 13635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef935c6a7c344ce8b8c7e75fa24de86e" candidate_uuid: "4046956b7fb7467092ada13b054b3eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baf2fe8a1cdb4f00b6581482ff5cd44f"
I20260812 02:46:42.231293 13635 raft_consensus.cc:3037] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:42.231293 13405 raft_consensus.cc:3037] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:42.232519 13635 raft_consensus.cc:2454] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4046956b7fb7467092ada13b054b3eab in term 1.
I20260812 02:46:42.232519 13405 raft_consensus.cc:2454] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4046956b7fb7467092ada13b054b3eab in term 1.
I20260812 02:46:42.232817 13054 leader_election.cc:302] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4046956b7fb7467092ada13b054b3eab, baf2fe8a1cdb4f00b6581482ff5cd44f; no voters:
I20260812 02:46:42.232975 13768 raft_consensus.cc:2781] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:42.233197 13768 raft_consensus.cc:686] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab [term 1 LEADER]: Becoming Leader. State: Replica: 4046956b7fb7467092ada13b054b3eab, State: Running, Role: LEADER
I20260812 02:46:42.233495 13768 consensus_queue.cc:237] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046956b7fb7467092ada13b054b3eab" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41267 } } peers { permanent_uuid: "3cb26394a9b84baa8b9fa8019f86c67a" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42757 } } peers { permanent_uuid: "baf2fe8a1cdb4f00b6581482ff5cd44f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 38999 } }
I20260812 02:46:42.236690 12920 catalog_manager.cc:5495] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab reported cstate change: term changed from 0 to 1, leader changed from <none> to 4046956b7fb7467092ada13b054b3eab (127.10.75.65). New cstate: current_term: 1 leader_uuid: "4046956b7fb7467092ada13b054b3eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046956b7fb7467092ada13b054b3eab" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 41267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cb26394a9b84baa8b9fa8019f86c67a" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baf2fe8a1cdb4f00b6581482ff5cd44f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 38999 } health_report { overall_health: UNKNOWN } } }
I20260812 02:46:42.246999 13747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:42.243745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54236 (local address 127.10.75.65:41267)
0812 02:46:42.243857 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:42.243861 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:42.243873 (+ 12us) server_negotiation.cc:407] Connection header received
0812 02:46:42.243954 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:42.243956 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:42.244002 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:42.244090 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:46:42.244302 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.244827 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.245639 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:42.245841 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:42.245921 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:42.246273 (+ 352us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:46:42.246635 (+ 362us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:46:42.246743 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:42.246861 (+ 118us) server_negotiation.cc:299] Negotiation successful
0812 02:46:42.246891 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260812 02:46:42.250734 13255 tablet.cc:2369] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:46:42.252562 13635 raft_consensus.cc:1261] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f [term 1 FOLLOWER]: Refusing update from remote peer 4046956b7fb7467092ada13b054b3eab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:46:42.252562 13405 raft_consensus.cc:1261] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a [term 1 FOLLOWER]: Refusing update from remote peer 4046956b7fb7467092ada13b054b3eab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:46:42.253264 13775 consensus_queue.cc:1035] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "baf2fe8a1cdb4f00b6581482ff5cd44f" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 38999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:46:42.253456 13768 consensus_queue.cc:1035] T ef935c6a7c344ce8b8c7e75fa24de86e P 4046956b7fb7467092ada13b054b3eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb26394a9b84baa8b9fa8019f86c67a" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:46:42.259936 13782 mvcc.cc:205] Tried to move back new op lower bound from 7317515478019088384 to 7317515477951082496. Current Snapshot: MvccSnapshot[applied={T|T < 7317515478019088384}]
I20260812 02:46:42.262305 13785 mvcc.cc:205] Tried to move back new op lower bound from 7317515478019088384 to 7317515477951082496. Current Snapshot: MvccSnapshot[applied={T|T < 7317515478019088384 or (T in {7317515478019088384})}]
I20260812 02:46:42.268461 12920 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53958:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:46:42.268625 12920 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53958:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:46:42.271109 12920 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 48d9c3ba50894dd19ea621959e653f07: Sending DeleteTablet for 3 replicas of tablet ef935c6a7c344ce8b8c7e75fa24de86e
I20260812 02:46:42.271910 13593 tablet_service.cc:1514] Processing DeleteTablet for tablet ef935c6a7c344ce8b8c7e75fa24de86e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:46:42 UTC) from {username='slave'} at 127.0.0.1:41962
I20260812 02:46:42.272079 13135 tablet_service.cc:1514] Processing DeleteTablet for tablet ef935c6a7c344ce8b8c7e75fa24de86e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:46:42 UTC) from {username='slave'} at 127.0.0.1:54234
I20260812 02:46:42.272406 13373 tablet_service.cc:1514] Processing DeleteTablet for tablet ef935c6a7c344ce8b8c7e75fa24de86e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:46:42 UTC) from {username='slave'} at 127.0.0.1:51322
I20260812 02:46:42.272550 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 13026
I20260812 02:46:42.272763 13795 tablet_replica.cc:330] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f: stopping tablet replica
I20260812 02:46:42.273118 13795 raft_consensus.cc:2229] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:46:42.273417 13795 raft_consensus.cc:2258] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:46:42.277113 13795 ts_tablet_manager.cc:1905] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:46:42.280735 13795 ts_tablet_manager.cc:1918] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:46:42.280893 13795 log.cc:1196] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/ef935c6a7c344ce8b8c7e75fa24de86e
I20260812 02:46:42.281283 13795 ts_tablet_manager.cc:1939] T ef935c6a7c344ce8b8c7e75fa24de86e P baf2fe8a1cdb4f00b6581482ff5cd44f: Deleting consensus metadata
I20260812 02:46:42.281459 13798 tablet_replica.cc:330] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a: stopping tablet replica
I20260812 02:46:42.281785 13798 raft_consensus.cc:2229] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:46:42.282235 13798 raft_consensus.cc:2258] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:46:42.282871 12897 catalog_manager.cc:4841] TS baf2fe8a1cdb4f00b6581482ff5cd44f (127.10.75.67:38999): tablet ef935c6a7c344ce8b8c7e75fa24de86e (table test-table [id=a1b1ff0153ff473fa4810b8eea87f3db]) successfully deleted
I20260812 02:46:42.283743 13798 ts_tablet_manager.cc:1905] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:46:42.285866 13798 ts_tablet_manager.cc:1918] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:46:42.285990 13798 log.cc:1196] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/ef935c6a7c344ce8b8c7e75fa24de86e
I20260812 02:46:42.286331 13798 ts_tablet_manager.cc:1939] T ef935c6a7c344ce8b8c7e75fa24de86e P 3cb26394a9b84baa8b9fa8019f86c67a: Deleting consensus metadata
I20260812 02:46:42.287352 12903 catalog_manager.cc:4841] TS 3cb26394a9b84baa8b9fa8019f86c67a (127.10.75.66:42757): tablet ef935c6a7c344ce8b8c7e75fa24de86e (table test-table [id=a1b1ff0153ff473fa4810b8eea87f3db]) successfully deleted
W20260812 02:46:42.288767 12903 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.75.65:41267 (error 108)
I20260812 02:46:42.288995 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 13258
I20260812 02:46:42.293757 13754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:42.293348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:41267 (local address 127.0.0.1:54242)
0812 02:46:42.293566 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:42.293653 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.65:41267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260812 02:46:42.294364 12903 catalog_manager.cc:4584] TS 4046956b7fb7467092ada13b054b3eab (127.10.75.65:41267): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ef935c6a7c344ce8b8c7e75fa24de86e: Network error: Client connection negotiation failed: client connection to 127.10.75.65:41267: connect: Connection refused (error 111)
I20260812 02:46:42.299093 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 13495
I20260812 02:46:42.314119 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 12868
2026-08-12T02:46:42Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1049 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:46:42 dist-test-slave-2p8l krb5kdc[13805](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:46:42 dist-test-slave-2p8l krb5kdc[13805](info): set up 2 sockets
Aug 12 02:46:42 dist-test-slave-2p8l krb5kdc[13805](info): commencing operation
krb5kdc: starting...
W20260812 02:46:43.642299 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.301s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:46:43 dist-test-slave-2p8l krb5kdc[13805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:46:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:46:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:46:43.772902 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:44673
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:42955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:44673
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:43.890100 13830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:43.890378 13830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:43.890419 13830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:43.894376 13830 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:46:43.894433 13830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:43.894452 13830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:43.894479 13830 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:46:43.894495 13830 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:46:43.899634 13830 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:42955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:44673
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:44673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:43.900605 13830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:43.901573 13830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:43.910218 13844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:43.910236 13839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:43.910316 13830 server_base.cc:1034] running on GCE node
W20260812 02:46:43.910276 13838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:43.911128 13830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:43.912470 13830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:43.913686 13830 hybrid_clock.cc:648] HybridClock initialized: now 1786502803913654 us; error 45 us; skew 500 ppm
Aug 12 02:46:43 dist-test-slave-2p8l krb5kdc[13805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502803, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:43.916750 13830 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:46:43.917753 13830 webserver.cc:460] Webserver started at http://127.10.75.126:40669/ using document root <none> and password file <none>
I20260812 02:46:43.918591 13830 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:43.918694 13830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:43.918931 13830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:43.921756 13830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "da13b35f9d124d078037ed8ca4d90b98"
format_stamp: "Formatted at 2026-08-12 02:46:43 on dist-test-slave-2p8l"
server_key: "84d91093a68096e4821e99064841c6ac"
server_key_iv: "97f0fb202939b845f271e5e6824f18bb"
server_key_version: "encryptionkey@0"
I20260812 02:46:43.922407 13830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "da13b35f9d124d078037ed8ca4d90b98"
format_stamp: "Formatted at 2026-08-12 02:46:43 on dist-test-slave-2p8l"
server_key: "84d91093a68096e4821e99064841c6ac"
server_key_iv: "97f0fb202939b845f271e5e6824f18bb"
server_key_version: "encryptionkey@0"
I20260812 02:46:43.926362 13830 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 02:46:43.928923 13854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:43.930292 13830 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:46:43.930421 13830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "da13b35f9d124d078037ed8ca4d90b98"
format_stamp: "Formatted at 2026-08-12 02:46:43 on dist-test-slave-2p8l"
server_key: "84d91093a68096e4821e99064841c6ac"
server_key_iv: "97f0fb202939b845f271e5e6824f18bb"
server_key_version: "encryptionkey@0"
I20260812 02:46:43.930523 13830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:43.959276 13830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:43.962515 13830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:43.962738 13830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:43.970093 13830 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:44673
I20260812 02:46:43.970177 13939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:44673 every 8 connection(s)
I20260812 02:46:43.971129 13830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:46:43.973915 13940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:43.979453 13940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98: Bootstrap starting.
I20260812 02:46:43.980469 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 13830
I20260812 02:46:43.980646 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:46:43.980965 10541 external_mini_cluster.cc:1428] Setting key aef33ab98caabccea834b32c626bec86
I20260812 02:46:43.982270 13940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:43.983242 13940 log.cc:824] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:43.985584 13940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98: No bootstrap required, opened a new log
I20260812 02:46:43.990177 13940 raft_consensus.cc:348] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da13b35f9d124d078037ed8ca4d90b98" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44673 } }
I20260812 02:46:43.990406 13940 raft_consensus.cc:374] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:43.990470 13940 raft_consensus.cc:729] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da13b35f9d124d078037ed8ca4d90b98, State: Initialized, Role: FOLLOWER
Aug 12 02:46:43 dist-test-slave-2p8l krb5kdc[13805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:46:43.990991 13940 consensus_queue.cc:260] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da13b35f9d124d078037ed8ca4d90b98" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44673 } }
I20260812 02:46:43.991148 13940 raft_consensus.cc:388] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:46:43.991242 13940 raft_consensus.cc:482] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:46:43.991370 13940 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:43.992583 13940 raft_consensus.cc:504] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da13b35f9d124d078037ed8ca4d90b98" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44673 } }
I20260812 02:46:43.992936 13940 leader_election.cc:302] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da13b35f9d124d078037ed8ca4d90b98; no voters:
I20260812 02:46:43.993315 13940 leader_election.cc:288] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:46:43.993395 13950 raft_consensus.cc:2781] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:43.993577 13950 raft_consensus.cc:686] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98 [term 1 LEADER]: Becoming Leader. State: Replica: da13b35f9d124d078037ed8ca4d90b98, State: Running, Role: LEADER
I20260812 02:46:43.993865 13950 consensus_queue.cc:237] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da13b35f9d124d078037ed8ca4d90b98" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44673 } }
I20260812 02:46:43.994629 13940 sys_catalog.cc:564] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:46:43.995076 13952 sys_catalog.cc:455] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader da13b35f9d124d078037ed8ca4d90b98. Latest consensus state: current_term: 1 leader_uuid: "da13b35f9d124d078037ed8ca4d90b98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da13b35f9d124d078037ed8ca4d90b98" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44673 } } }
I20260812 02:46:43.995195 13952 sys_catalog.cc:458] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98 [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:43.995913 13951 sys_catalog.cc:455] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da13b35f9d124d078037ed8ca4d90b98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da13b35f9d124d078037ed8ca4d90b98" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44673 } } }
I20260812 02:46:43.996038 13951 sys_catalog.cc:458] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98 [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:43.996312 13958 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:46:43.997200 13948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:43.982237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37454 (local address 127.10.75.126:44673)
0812 02:46:43.982797 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:43.982816 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:43.982859 (+ 43us) server_negotiation.cc:407] Connection header received
0812 02:46:43.983781 (+ 922us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:43.983802 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:43.984185 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:43.984562 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:43.985272 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:43.986740 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:43.987706 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:43.988458 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:43.988659 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:43.991436 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:43.991442 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:43.991455 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:43.991502 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:43.993332 (+ 1830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:43.993915 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:43.993923 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:43.993930 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:43.994095 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:43.994429 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:43.994432 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:43.994433 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:43.994930 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:43.995756 (+ 826us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:43.995914 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 02:46:43.996237 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":215,"threads_started":1}
I20260812 02:46:43.999660 13958 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:46:44.005383 13958 catalog_manager.cc:1347] Generated new cluster ID: bc7c92c1089643e4bc9c3d1f1dfc3958
I20260812 02:46:44.005463 13958 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:46:44.028311 13958 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:46:44.029573 13958 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:46:44.038021 13958 catalog_manager.cc:5868] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98: Generated new TSK 0
I20260812 02:46:44.038769 13958 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.75.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
Entry for principal kudu/127.10.75.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab.
I20260812 02:46:44.077747 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:44673
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:42955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:44.207180 13986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:44.207448 13986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:44.207491 13986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:44.211611 13986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:44.211678 13986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:44.211735 13986 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:46:44.217289 13986 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:42955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.65.keytab
--principal=kudu/127.10.75.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:44673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:44.218401 13986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:44.219529 13986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:44.230405 13994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:44.230408 13995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:44.230405 13998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:44.230849 13986 server_base.cc:1034] running on GCE node
I20260812 02:46:44.231221 13986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:44.231881 13986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:44.233052 13986 hybrid_clock.cc:648] HybridClock initialized: now 1786502804233031 us; error 34 us; skew 500 ppm
Aug 12 02:46:44 dist-test-slave-2p8l krb5kdc[13805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502804, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:44.236213 13986 init.cc:377] Logged in from keytab as kudu/127.10.75.65@KRBTEST.COM (short username kudu)
I20260812 02:46:44.237140 13986 webserver.cc:460] Webserver started at http://127.10.75.65:45107/ using document root <none> and password file <none>
I20260812 02:46:44.237725 13986 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:44.237788 13986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:44.238026 13986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:44.240087 13986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "eb014328e0e34c98ac46d9789c14ad03"
format_stamp: "Formatted at 2026-08-12 02:46:44 on dist-test-slave-2p8l"
server_key: "0ba49a21266a3426f30ac76613219fcf"
server_key_iv: "e4a9f87e1a1c9728fd53df63794599d1"
server_key_version: "encryptionkey@0"
I20260812 02:46:44.240677 13986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "eb014328e0e34c98ac46d9789c14ad03"
format_stamp: "Formatted at 2026-08-12 02:46:44 on dist-test-slave-2p8l"
server_key: "0ba49a21266a3426f30ac76613219fcf"
server_key_iv: "e4a9f87e1a1c9728fd53df63794599d1"
server_key_version: "encryptionkey@0"
I20260812 02:46:44.244691 13986 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260812 02:46:44.247332 14008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:44.248737 13986 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 02:46:44.248891 13986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "eb014328e0e34c98ac46d9789c14ad03"
format_stamp: "Formatted at 2026-08-12 02:46:44 on dist-test-slave-2p8l"
server_key: "0ba49a21266a3426f30ac76613219fcf"
server_key_iv: "e4a9f87e1a1c9728fd53df63794599d1"
server_key_version: "encryptionkey@0"
I20260812 02:46:44.249015 13986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:44.267545 13986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:44.270740 13986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:44.270960 13986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:44.271588 13986 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:44.272449 13986 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:44.272497 13986 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:44.272568 13986 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:44.272600 13986 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:44.281975 13986 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:42307
I20260812 02:46:44.281996 14195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:42307 every 8 connection(s)
I20260812 02:46:44.282917 13986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:46:44.286358 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 13986
I20260812 02:46:44.286496 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:46:44.286788 10541 external_mini_cluster.cc:1428] Setting key 218eb00b0c401e0cd920ed4c390bb5e5
Aug 12 02:46:44 dist-test-slave-2p8l krb5kdc[13805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502804, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.65@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.75.66@KRBTEST.COM; defaulting to no policy
I20260812 02:46:44.297973 13948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.284819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:39683 (local address 127.10.75.126:44673)
0812 02:46:44.284978 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:44.284981 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:44.285821 (+ 840us) server_negotiation.cc:407] Connection header received
0812 02:46:44.287293 (+ 1472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:44.287296 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:44.287375 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:44.287479 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:44.288643 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.289179 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.290546 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.290794 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.290883 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:44.293874 (+ 2991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:44.293878 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:44.293880 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:44.293905 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:44.295558 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:44.296216 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:44.296219 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:44.296221 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:44.296307 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:44.296661 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:44.296666 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:44.296667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:44.296982 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:44.297089 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:44.297650 (+ 561us) server_negotiation.cc:299] Negotiation successful
0812 02:46:44.297792 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 02:46:44.298905 14200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.285186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:44673 (local address 127.10.75.65:39683)
0812 02:46:44.285675 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:44.285719 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:44.287076 (+ 1357us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:44.287667 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:44.287674 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:44.288029 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:44.288493 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:44.288508 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.289321 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.289324 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:44.290415 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:44.290428 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.290961 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.290967 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:44.291186 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:44.291888 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:46:44.291914 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:44.293697 (+ 1783us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:44.295739 (+ 2042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:44.295745 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:44.295760 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:44.296091 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:44.296402 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:44.296406 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:44.296408 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:44.296551 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:44.297089 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:44.297097 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:44.297356 (+ 259us) client_negotiation.cc:769] Sending connection context
0812 02:46:44.297610 (+ 254us) client_negotiation.cc:240] Negotiation successful
0812 02:46:44.297932 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":122,"threads_started":1}
I20260812 02:46:44.300235 14197 heartbeater.cc:347] Connected to a master server at 127.10.75.126:44673
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.66@KRBTEST.COM" created.
I20260812 02:46:44.300524 14197 heartbeater.cc:464] Registering TS with master...
I20260812 02:46:44.301074 14197 heartbeater.cc:511] Master 127.10.75.126:44673 requested a full tablet report, sending...
I20260812 02:46:44.302830 13882 ts_manager.cc:194] Registered new tserver with Master: eb014328e0e34c98ac46d9789c14ad03 (127.10.75.65:42307)
I20260812 02:46:44.304134 13882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.65@KRBTEST.COM'} at 127.10.75.65:39683
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
Entry for principal kudu/127.10.75.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab.
I20260812 02:46:44.318045 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:44673
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:42955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:44.430934 14204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:44.431190 14204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:44.431232 14204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:44.435467 14204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:44.435524 14204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:44.435626 14204 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:46:44.440845 14204 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:42955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.66.keytab
--principal=kudu/127.10.75.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:44673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:44.441982 14204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:44.443086 14204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:44.452991 14212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:44.453085 14221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:44.452986 14217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:44.453230 14204 server_base.cc:1034] running on GCE node
I20260812 02:46:44.453687 14204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:44.454403 14204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:44.455590 14204 hybrid_clock.cc:648] HybridClock initialized: now 1786502804455574 us; error 33 us; skew 500 ppm
Aug 12 02:46:44 dist-test-slave-2p8l krb5kdc[13805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502804, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:44.458329 14204 init.cc:377] Logged in from keytab as kudu/127.10.75.66@KRBTEST.COM (short username kudu)
I20260812 02:46:44.459159 14204 webserver.cc:460] Webserver started at http://127.10.75.66:36385/ using document root <none> and password file <none>
I20260812 02:46:44.459714 14204 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:44.459808 14204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:44.460039 14204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:44.462117 14204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "bf6720c97e00457181af3fc779ecadaa"
format_stamp: "Formatted at 2026-08-12 02:46:44 on dist-test-slave-2p8l"
server_key: "02c639bd665bfad79dff3f19f8e29b05"
server_key_iv: "ab8c80852315741af876872fabd0a2da"
server_key_version: "encryptionkey@0"
I20260812 02:46:44.462739 14204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "bf6720c97e00457181af3fc779ecadaa"
format_stamp: "Formatted at 2026-08-12 02:46:44 on dist-test-slave-2p8l"
server_key: "02c639bd665bfad79dff3f19f8e29b05"
server_key_iv: "ab8c80852315741af876872fabd0a2da"
server_key_version: "encryptionkey@0"
I20260812 02:46:44.466516 14204 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 02:46:44.468906 14232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:44.470048 14204 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:46:44.470268 14204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "bf6720c97e00457181af3fc779ecadaa"
format_stamp: "Formatted at 2026-08-12 02:46:44 on dist-test-slave-2p8l"
server_key: "02c639bd665bfad79dff3f19f8e29b05"
server_key_iv: "ab8c80852315741af876872fabd0a2da"
server_key_version: "encryptionkey@0"
I20260812 02:46:44.470382 14204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:44.485713 14204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:44.488986 14204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:44.489197 14204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:44.489789 14204 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:44.490672 14204 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:44.490746 14204 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:44.490816 14204 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:44.490867 14204 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:44.500768 14204 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:44705
I20260812 02:46:44.500793 14437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:44705 every 8 connection(s)
I20260812 02:46:44.501627 14204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:46:44.505802 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 14204
I20260812 02:46:44.505944 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:46:44.506260 10541 external_mini_cluster.cc:1428] Setting key 28ec13974c71d0fdb7d51533d2c8b12f
Aug 12 02:46:44 dist-test-slave-2p8l krb5kdc[13805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502804, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.66@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:46:44.515465 13948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.503493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:43477 (local address 127.10.75.126:44673)
0812 02:46:44.503631 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:44.503635 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:44.504611 (+ 976us) server_negotiation.cc:407] Connection header received
0812 02:46:44.505574 (+ 963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:44.505578 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:44.505645 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:44.505742 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:44.507169 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.507796 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.508923 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.509145 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.509279 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:44.511767 (+ 2488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:44.511771 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:44.511774 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:44.511804 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:44.513342 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:44.513884 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:44.513889 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:44.513891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:44.513975 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:44.514367 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:44.514372 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:44.514373 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:44.514556 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:44.514704 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:44.515167 (+ 463us) server_negotiation.cc:299] Negotiation successful
0812 02:46:44.515291 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
WARNING: no policy specified for kudu/127.10.75.67@KRBTEST.COM; defaulting to no policy
I20260812 02:46:44.516304 14440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.503759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:44673 (local address 127.10.75.66:43477)
0812 02:46:44.504430 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:44.504469 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:44.505317 (+ 848us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:44.505953 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:44.505963 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:44.506444 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:44.507023 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:44.507040 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.507921 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.507924 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:44.508794 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:44.508804 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.509319 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.509324 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:44.509493 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:44.510155 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:46:44.510172 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:44.511601 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:44.513484 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:44.513490 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:44.513505 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:44.513774 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:44.514095 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:44.514099 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:44.514101 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:44.514264 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:44.514671 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:44.514678 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:44.514926 (+ 248us) client_negotiation.cc:769] Sending connection context
0812 02:46:44.515107 (+ 181us) client_negotiation.cc:240] Negotiation successful
0812 02:46:44.515433 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":116,"threads_started":1}
I20260812 02:46:44.517469 14438 heartbeater.cc:347] Connected to a master server at 127.10.75.126:44673
I20260812 02:46:44.517722 14438 heartbeater.cc:464] Registering TS with master...
I20260812 02:46:44.518265 14438 heartbeater.cc:511] Master 127.10.75.126:44673 requested a full tablet report, sending...
I20260812 02:46:44.519377 13882 ts_manager.cc:194] Registered new tserver with Master: bf6720c97e00457181af3fc779ecadaa (127.10.75.66:44705)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.67@KRBTEST.COM" created.
I20260812 02:46:44.520035 13882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.66@KRBTEST.COM'} at 127.10.75.66:43477
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
Entry for principal kudu/127.10.75.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab.
I20260812 02:46:44.537537 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:44673
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:42955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:44.649559 14446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:44.649794 14446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:44.649838 14446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:44.654026 14446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:44.654135 14446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:44.654238 14446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:46:44.659430 14446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:42955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.67.keytab
--principal=kudu/127.10.75.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:44673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:44.660440 14446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:44.661432 14446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:44.671219 14452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:44.671217 14453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:44.671451 14446 server_base.cc:1034] running on GCE node
W20260812 02:46:44.671686 14455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:44.672128 14446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:44.672791 14446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:44.674024 14446 hybrid_clock.cc:648] HybridClock initialized: now 1786502804673988 us; error 45 us; skew 500 ppm
Aug 12 02:46:44 dist-test-slave-2p8l krb5kdc[13805](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502804, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:44.676900 14446 init.cc:377] Logged in from keytab as kudu/127.10.75.67@KRBTEST.COM (short username kudu)
I20260812 02:46:44.677716 14446 webserver.cc:460] Webserver started at http://127.10.75.67:41175/ using document root <none> and password file <none>
I20260812 02:46:44.678355 14446 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:44.678422 14446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:44.678591 14446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:44.680593 14446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "da80bab6aa794ca8becbac14992f0e17"
format_stamp: "Formatted at 2026-08-12 02:46:44 on dist-test-slave-2p8l"
server_key: "6fb05bc4f2d8b3efa7a5f3d4d5aa7934"
server_key_iv: "35c9db364f3dd1aec8f343f555da181e"
server_key_version: "encryptionkey@0"
I20260812 02:46:44.681136 14446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "da80bab6aa794ca8becbac14992f0e17"
format_stamp: "Formatted at 2026-08-12 02:46:44 on dist-test-slave-2p8l"
server_key: "6fb05bc4f2d8b3efa7a5f3d4d5aa7934"
server_key_iv: "35c9db364f3dd1aec8f343f555da181e"
server_key_version: "encryptionkey@0"
I20260812 02:46:44.684816 14446 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260812 02:46:44.687160 14469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:44.688339 14446 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:46:44.688447 14446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "da80bab6aa794ca8becbac14992f0e17"
format_stamp: "Formatted at 2026-08-12 02:46:44 on dist-test-slave-2p8l"
server_key: "6fb05bc4f2d8b3efa7a5f3d4d5aa7934"
server_key_iv: "35c9db364f3dd1aec8f343f555da181e"
server_key_version: "encryptionkey@0"
I20260812 02:46:44.688529 14446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:44.717634 14446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:44.720777 14446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:44.720935 14446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:44.721474 14446 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:44.722281 14446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:44.722329 14446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:44.722368 14446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:44.722393 14446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:44.731303 14446 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:44031
I20260812 02:46:44.731357 14680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:44031 every 8 connection(s)
I20260812 02:46:44.732270 14446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:46:44.734931 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 14446
I20260812 02:46:44.735102 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:46:44.735495 10541 external_mini_cluster.cc:1428] Setting key 459a71eed8f299c58d8fd9feff80531e
Aug 12 02:46:44 dist-test-slave-2p8l krb5kdc[13805](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502804, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.67@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:46:44.746970 13948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.734295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:39277 (local address 127.10.75.126:44673)
0812 02:46:44.734478 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:44.734482 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:44.735925 (+ 1443us) server_negotiation.cc:407] Connection header received
0812 02:46:44.737077 (+ 1152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:44.737080 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:44.737126 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:44.737197 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:44.738477 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.739035 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.740304 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.740516 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.740602 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:44.743259 (+ 2657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:44.743262 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:44.743265 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:44.743289 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:44.744798 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:44.745433 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:44.745436 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:44.745438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:44.745517 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:44.745852 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:44.745854 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:44.745855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:44.746021 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:44.746175 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:44.746654 (+ 479us) server_negotiation.cc:299] Negotiation successful
0812 02:46:44.746793 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 02:46:44.747762 14683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.734926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:44673 (local address 127.10.75.67:39277)
0812 02:46:44.735739 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:44.735782 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:44.736847 (+ 1065us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:44.737361 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:44.737371 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:44.737770 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:44.738330 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:44.738345 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.739152 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.739155 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:44.740193 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:44.740202 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.740648 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.740651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:44.740787 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:44.741331 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:46:44.741347 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:44.743081 (+ 1734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:44.744952 (+ 1871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:44.744957 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:44.744969 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:44.745320 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:44.745610 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:46:44.745613 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:46:44.745614 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:46:44.745758 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:46:44.746179 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:44.746185 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:44.746422 (+ 237us) client_negotiation.cc:769] Sending connection context
0812 02:46:44.746587 (+ 165us) client_negotiation.cc:240] Negotiation successful
0812 02:46:44.746865 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":171,"threads_started":1}
I20260812 02:46:44.749030 14681 heartbeater.cc:347] Connected to a master server at 127.10.75.126:44673
I20260812 02:46:44.749290 14681 heartbeater.cc:464] Registering TS with master...
I20260812 02:46:44.749840 14681 heartbeater.cc:511] Master 127.10.75.126:44673 requested a full tablet report, sending...
I20260812 02:46:44.750938 13882 ts_manager.cc:194] Registered new tserver with Master: da80bab6aa794ca8becbac14992f0e17 (127.10.75.67:44031)
I20260812 02:46:44.751614 13882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.75.67@KRBTEST.COM'} at 127.10.75.67:39277
I20260812 02:46:44.761555 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:46:44.771658 13948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.763751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37460 (local address 127.10.75.126:44673)
0812 02:46:44.763894 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:44.763898 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:44.763913 (+ 15us) server_negotiation.cc:407] Connection header received
0812 02:46:44.764006 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:44.764009 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:44.764062 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:44.764139 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:44.764890 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.765451 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.766585 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.766820 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.766917 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:44.768409 (+ 1492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:44.768412 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:44.768414 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:44.768437 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:44.769822 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:44.770326 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:44.770329 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:44.770330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:44.770406 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:44.770681 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:44.770683 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:44.770684 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:44.770901 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:44.771009 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:44.771367 (+ 358us) server_negotiation.cc:299] Negotiation successful
0812 02:46:44.771484 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 02:46:44.774840 13882 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37460:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:46:44.778077 13882 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:46:44.793788 14697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.787086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:42307 (local address 127.0.0.1:48522)
0812 02:46:44.788037 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:44.788095 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:44.788244 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:44.789036 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:44.789043 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:44.789086 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:44.789318 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:44.789325 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.791008 (+ 1683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.791010 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:44.791966 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:44.791978 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.793077 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.793081 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:44.793276 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:44.793319 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 02:46:44.793436 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 02:46:44.793584 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":745,"mutex_wait_us":78,"spinlock_wait_cycles":8704,"thread_start_us":107,"threads_started":1}
I20260812 02:46:44.794137 14704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.787994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32950 (local address 127.10.75.66:44705)
0812 02:46:44.788565 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:44.788580 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:44.788608 (+ 28us) server_negotiation.cc:407] Connection header received
0812 02:46:44.788705 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:44.788709 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:44.788874 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:44.789058 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:44.789440 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.790599 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.792562 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.793350 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.793481 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:44.793612 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:44.793869 (+ 257us) server_negotiation.cc:299] Negotiation successful
0812 02:46:44.793969 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":173,"threads_started":1}
I20260812 02:46:44.794461 14699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.787300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:44705 (local address 127.0.0.1:32950)
0812 02:46:44.788409 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:44.788424 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:44.788520 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:44.789049 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:44.789052 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:44.789088 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:44.789291 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:44.789299 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.790768 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.790771 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:44.792426 (+ 1655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:44.792439 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.793481 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.793485 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:44.793593 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:44.793616 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 02:46:44.793692 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 02:46:44.793763 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1047,"mutex_wait_us":72,"spinlock_wait_cycles":4736,"thread_start_us":108,"threads_started":1}
I20260812 02:46:44.794484 14698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.787250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48522 (local address 127.10.75.65:42307)
0812 02:46:44.788615 (+ 1365us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:44.788636 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:44.788655 (+ 19us) server_negotiation.cc:407] Connection header received
0812 02:46:44.788722 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:44.788726 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:44.788870 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:44.789018 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:44.789452 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.790664 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.792113 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.792871 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.793021 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:44.793168 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:44.794223 (+ 1055us) server_negotiation.cc:299] Negotiation successful
0812 02:46:44.794333 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1235,"thread_start_us":72,"threads_started":1}
I20260812 02:46:44.795148 14701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.787930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:44031 (local address 127.0.0.1:53426)
0812 02:46:44.788451 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:44.788466 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:44.788571 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:44.789801 (+ 1230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:44.789805 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:44.789826 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:44.789924 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:44.789931 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.791251 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.791255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:44.792740 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:44.792758 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.794407 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.794411 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:44.794781 (+ 370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:44.794804 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 02:46:44.794903 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 02:46:44.794971 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"mutex_wait_us":4,"thread_start_us":128,"threads_started":1}
I20260812 02:46:44.795657 14705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.788141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53426 (local address 127.10.75.67:44031)
0812 02:46:44.789343 (+ 1202us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:44.789358 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:44.789378 (+ 20us) server_negotiation.cc:407] Connection header received
0812 02:46:44.789451 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:44.789455 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:44.789643 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:44.789787 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:44.790053 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.791115 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.792875 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.793807 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.794123 (+ 316us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:44.795403 (+ 1280us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:44.795464 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 02:46:44.795539 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1101,"thread_start_us":134,"threads_started":1}
I20260812 02:46:44.797564 14324 tablet_service.cc:1467] Processing CreateTablet for tablet cb5747eba92948ef896d0bb41e100c98 (DEFAULT_TABLE table=test-table [id=f2da20e8c20249e2a3b9dcef6896b1df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:46:44.797556 14087 tablet_service.cc:1467] Processing CreateTablet for tablet cb5747eba92948ef896d0bb41e100c98 (DEFAULT_TABLE table=test-table [id=f2da20e8c20249e2a3b9dcef6896b1df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:46:44.798740 14087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb5747eba92948ef896d0bb41e100c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:44.798740 14324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb5747eba92948ef896d0bb41e100c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:44.800721 14566 tablet_service.cc:1467] Processing CreateTablet for tablet cb5747eba92948ef896d0bb41e100c98 (DEFAULT_TABLE table=test-table [id=f2da20e8c20249e2a3b9dcef6896b1df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:46:44.801673 14566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb5747eba92948ef896d0bb41e100c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:44.806221 14709 tablet_bootstrap.cc:492] T cb5747eba92948ef896d0bb41e100c98 P eb014328e0e34c98ac46d9789c14ad03: Bootstrap starting.
I20260812 02:46:44.806711 14710 tablet_bootstrap.cc:492] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa: Bootstrap starting.
I20260812 02:46:44.808578 14712 tablet_bootstrap.cc:492] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17: Bootstrap starting.
I20260812 02:46:44.810562 14712 tablet_bootstrap.cc:654] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:44.811224 14709 tablet_bootstrap.cc:654] T cb5747eba92948ef896d0bb41e100c98 P eb014328e0e34c98ac46d9789c14ad03: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:44.811681 14712 log.cc:824] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:44.811990 14709 log.cc:824] T cb5747eba92948ef896d0bb41e100c98 P eb014328e0e34c98ac46d9789c14ad03: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:44.812769 14710 tablet_bootstrap.cc:654] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:44.813724 14709 tablet_bootstrap.cc:492] T cb5747eba92948ef896d0bb41e100c98 P eb014328e0e34c98ac46d9789c14ad03: No bootstrap required, opened a new log
I20260812 02:46:44.813938 14709 ts_tablet_manager.cc:1397] T cb5747eba92948ef896d0bb41e100c98 P eb014328e0e34c98ac46d9789c14ad03: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260812 02:46:44.813998 14712 tablet_bootstrap.cc:492] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17: No bootstrap required, opened a new log
I20260812 02:46:44.814127 14710 log.cc:824] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:44.814239 14712 ts_tablet_manager.cc:1397] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.002s
I20260812 02:46:44.816220 14710 tablet_bootstrap.cc:492] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa: No bootstrap required, opened a new log
I20260812 02:46:44.816418 14710 ts_tablet_manager.cc:1397] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260812 02:46:44.817812 14709 raft_consensus.cc:348] T cb5747eba92948ef896d0bb41e100c98 P eb014328e0e34c98ac46d9789c14ad03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb014328e0e34c98ac46d9789c14ad03" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42307 } } peers { permanent_uuid: "bf6720c97e00457181af3fc779ecadaa" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 44705 } } peers { permanent_uuid: "da80bab6aa794ca8becbac14992f0e17" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44031 } }
I20260812 02:46:44.818061 14709 raft_consensus.cc:374] T cb5747eba92948ef896d0bb41e100c98 P eb014328e0e34c98ac46d9789c14ad03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:44.818133 14709 raft_consensus.cc:729] T cb5747eba92948ef896d0bb41e100c98 P eb014328e0e34c98ac46d9789c14ad03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb014328e0e34c98ac46d9789c14ad03, State: Initialized, Role: FOLLOWER
I20260812 02:46:44.818404 14712 raft_consensus.cc:348] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb014328e0e34c98ac46d9789c14ad03" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42307 } } peers { permanent_uuid: "bf6720c97e00457181af3fc779ecadaa" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 44705 } } peers { permanent_uuid: "da80bab6aa794ca8becbac14992f0e17" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44031 } }
I20260812 02:46:44.818576 14709 consensus_queue.cc:260] T cb5747eba92948ef896d0bb41e100c98 P eb014328e0e34c98ac46d9789c14ad03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb014328e0e34c98ac46d9789c14ad03" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42307 } } peers { permanent_uuid: "bf6720c97e00457181af3fc779ecadaa" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 44705 } } peers { permanent_uuid: "da80bab6aa794ca8becbac14992f0e17" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44031 } }
I20260812 02:46:44.818694 14712 raft_consensus.cc:374] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:44.818756 14712 raft_consensus.cc:729] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da80bab6aa794ca8becbac14992f0e17, State: Initialized, Role: FOLLOWER
I20260812 02:46:44.819247 14197 heartbeater.cc:503] Master 127.10.75.126:44673 was elected leader, sending a full tablet report...
I20260812 02:46:44.819183 14712 consensus_queue.cc:260] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb014328e0e34c98ac46d9789c14ad03" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42307 } } peers { permanent_uuid: "bf6720c97e00457181af3fc779ecadaa" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 44705 } } peers { permanent_uuid: "da80bab6aa794ca8becbac14992f0e17" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44031 } }
I20260812 02:46:44.819820 14681 heartbeater.cc:503] Master 127.10.75.126:44673 was elected leader, sending a full tablet report...
I20260812 02:46:44.820227 14712 ts_tablet_manager.cc:1428] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17: Time spent starting tablet: real 0.006s user 0.004s sys 0.002s
I20260812 02:46:44.820549 14710 raft_consensus.cc:348] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb014328e0e34c98ac46d9789c14ad03" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42307 } } peers { permanent_uuid: "bf6720c97e00457181af3fc779ecadaa" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 44705 } } peers { permanent_uuid: "da80bab6aa794ca8becbac14992f0e17" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44031 } }
I20260812 02:46:44.820833 14710 raft_consensus.cc:374] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:44.820941 14710 raft_consensus.cc:729] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf6720c97e00457181af3fc779ecadaa, State: Initialized, Role: FOLLOWER
I20260812 02:46:44.821389 14710 consensus_queue.cc:260] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb014328e0e34c98ac46d9789c14ad03" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42307 } } peers { permanent_uuid: "bf6720c97e00457181af3fc779ecadaa" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 44705 } } peers { permanent_uuid: "da80bab6aa794ca8becbac14992f0e17" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44031 } }
I20260812 02:46:44.822147 14438 heartbeater.cc:503] Master 127.10.75.126:44673 was elected leader, sending a full tablet report...
I20260812 02:46:44.822556 14710 ts_tablet_manager.cc:1428] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 02:46:44.823029 14709 ts_tablet_manager.cc:1428] T cb5747eba92948ef896d0bb41e100c98 P eb014328e0e34c98ac46d9789c14ad03: Time spent starting tablet: real 0.009s user 0.004s sys 0.003s
I20260812 02:46:44.865299 14722 raft_consensus.cc:482] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:46:44.865535 14722 raft_consensus.cc:504] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb014328e0e34c98ac46d9789c14ad03" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42307 } } peers { permanent_uuid: "bf6720c97e00457181af3fc779ecadaa" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 44705 } } peers { permanent_uuid: "da80bab6aa794ca8becbac14992f0e17" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44031 } }
I20260812 02:46:44.866768 14722 leader_election.cc:288] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb014328e0e34c98ac46d9789c14ad03 (127.10.75.65:42307), da80bab6aa794ca8becbac14992f0e17 (127.10.75.67:44031)
I20260812 02:46:44.870862 14698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.867119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:53909 (local address 127.10.75.65:42307)
0812 02:46:44.867259 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:44.867264 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:44.867280 (+ 16us) server_negotiation.cc:407] Connection header received
0812 02:46:44.867339 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:44.867343 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:44.867394 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:44.867469 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:44.867924 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.868746 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.869802 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.870294 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.870425 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:44.870479 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:44.870677 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 02:46:44.870753 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 02:46:44.870862 14440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.866997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:42307 (local address 127.10.75.66:53909)
0812 02:46:44.867137 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:44.867155 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:44.867246 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:44.867629 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:44.867632 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:44.867654 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:44.867786 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:44.867795 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.868865 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.868868 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:44.869664 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:44.869674 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.870426 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.870429 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:44.870546 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:44.870564 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 02:46:44.870657 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 02:46:44.870730 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 02:46:44.871028 14723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.867016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:44031 (local address 127.10.75.66:38771)
0812 02:46:44.867507 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:44.867571 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:44.867704 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:44.868003 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:44.868005 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:44.868020 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:44.868114 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:44.868118 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.869045 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.869050 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:44.869852 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:44.869861 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.870559 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.870562 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:44.870675 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:44.870701 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 02:46:44.870791 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 02:46:44.870861 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"mutex_wait_us":119,"spinlock_wait_cycles":22400,"thread_start_us":154,"threads_started":1}
I20260812 02:46:44.871006 14705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.867129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:38771 (local address 127.10.75.67:44031)
0812 02:46:44.867509 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:44.867514 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:44.867668 (+ 154us) server_negotiation.cc:407] Connection header received
0812 02:46:44.867832 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:44.867834 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:44.867906 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:44.867984 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:44.868230 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.868925 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.869986 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.870423 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.870558 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:44.870611 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:44.870810 (+ 199us) server_negotiation.cc:299] Negotiation successful
0812 02:46:44.870879 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295}
I20260812 02:46:44.871603 14118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5747eba92948ef896d0bb41e100c98" candidate_uuid: "bf6720c97e00457181af3fc779ecadaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb014328e0e34c98ac46d9789c14ad03" is_pre_election: true
I20260812 02:46:44.871623 14607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5747eba92948ef896d0bb41e100c98" candidate_uuid: "bf6720c97e00457181af3fc779ecadaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da80bab6aa794ca8becbac14992f0e17" is_pre_election: true
I20260812 02:46:44.871901 14607 raft_consensus.cc:2454] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf6720c97e00457181af3fc779ecadaa in term 0.
I20260812 02:46:44.871914 14118 raft_consensus.cc:2454] T cb5747eba92948ef896d0bb41e100c98 P eb014328e0e34c98ac46d9789c14ad03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf6720c97e00457181af3fc779ecadaa in term 0.
I20260812 02:46:44.872421 14235 leader_election.cc:302] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: bf6720c97e00457181af3fc779ecadaa, da80bab6aa794ca8becbac14992f0e17, eb014328e0e34c98ac46d9789c14ad03; no voters:
I20260812 02:46:44.872752 14722 raft_consensus.cc:2781] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:46:44.872844 14722 raft_consensus.cc:482] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:46:44.872908 14722 raft_consensus.cc:3037] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:44.874205 14722 raft_consensus.cc:504] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb014328e0e34c98ac46d9789c14ad03" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42307 } } peers { permanent_uuid: "bf6720c97e00457181af3fc779ecadaa" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 44705 } } peers { permanent_uuid: "da80bab6aa794ca8becbac14992f0e17" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44031 } }
I20260812 02:46:44.874591 14722 leader_election.cc:288] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa [CANDIDATE]: Term 1 election: Requested vote from peers eb014328e0e34c98ac46d9789c14ad03 (127.10.75.65:42307), da80bab6aa794ca8becbac14992f0e17 (127.10.75.67:44031)
I20260812 02:46:44.875010 14607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5747eba92948ef896d0bb41e100c98" candidate_uuid: "bf6720c97e00457181af3fc779ecadaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da80bab6aa794ca8becbac14992f0e17"
I20260812 02:46:44.875026 14118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb5747eba92948ef896d0bb41e100c98" candidate_uuid: "bf6720c97e00457181af3fc779ecadaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb014328e0e34c98ac46d9789c14ad03"
I20260812 02:46:44.875119 14607 raft_consensus.cc:3037] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:44.875178 14118 raft_consensus.cc:3037] T cb5747eba92948ef896d0bb41e100c98 P eb014328e0e34c98ac46d9789c14ad03 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:44.876230 14607 raft_consensus.cc:2454] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf6720c97e00457181af3fc779ecadaa in term 1.
I20260812 02:46:44.876353 14118 raft_consensus.cc:2454] T cb5747eba92948ef896d0bb41e100c98 P eb014328e0e34c98ac46d9789c14ad03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf6720c97e00457181af3fc779ecadaa in term 1.
I20260812 02:46:44.876552 14235 leader_election.cc:302] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bf6720c97e00457181af3fc779ecadaa, da80bab6aa794ca8becbac14992f0e17; no voters:
I20260812 02:46:44.876741 14722 raft_consensus.cc:2781] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:44.876988 14722 raft_consensus.cc:686] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa [term 1 LEADER]: Becoming Leader. State: Replica: bf6720c97e00457181af3fc779ecadaa, State: Running, Role: LEADER
I20260812 02:46:44.877391 14722 consensus_queue.cc:237] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb014328e0e34c98ac46d9789c14ad03" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42307 } } peers { permanent_uuid: "bf6720c97e00457181af3fc779ecadaa" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 44705 } } peers { permanent_uuid: "da80bab6aa794ca8becbac14992f0e17" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44031 } }
I20260812 02:46:44.880723 13880 catalog_manager.cc:5495] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa reported cstate change: term changed from 0 to 1, leader changed from <none> to bf6720c97e00457181af3fc779ecadaa (127.10.75.66). New cstate: current_term: 1 leader_uuid: "bf6720c97e00457181af3fc779ecadaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb014328e0e34c98ac46d9789c14ad03" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf6720c97e00457181af3fc779ecadaa" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 44705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da80bab6aa794ca8becbac14992f0e17" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44031 } health_report { overall_health: UNKNOWN } } }
I20260812 02:46:44.891717 14704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.888048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32956 (local address 127.10.75.66:44705)
0812 02:46:44.888214 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:44.888217 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:44.888258 (+ 41us) server_negotiation.cc:407] Connection header received
0812 02:46:44.888325 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:44.888328 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:44.888382 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:44.888468 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:46:44.888704 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.889258 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.890133 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:44.890386 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:44.890496 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:44.890813 (+ 317us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:46:44.891252 (+ 439us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:46:44.891411 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:44.891442 (+ 31us) server_negotiation.cc:299] Negotiation successful
0812 02:46:44.891498 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 02:46:44.897838 14607 raft_consensus.cc:1261] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17 [term 1 FOLLOWER]: Refusing update from remote peer bf6720c97e00457181af3fc779ecadaa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:46:44.897895 14118 raft_consensus.cc:1261] T cb5747eba92948ef896d0bb41e100c98 P eb014328e0e34c98ac46d9789c14ad03 [term 1 FOLLOWER]: Refusing update from remote peer bf6720c97e00457181af3fc779ecadaa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:46:44.898651 14722 consensus_queue.cc:1035] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "da80bab6aa794ca8becbac14992f0e17" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:46:44.898927 14724 consensus_queue.cc:1035] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb014328e0e34c98ac46d9789c14ad03" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 42307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:46:44.906437 14733 mvcc.cc:205] Tried to move back new op lower bound from 7317515488854118400 to 7317515488780791808. Current Snapshot: MvccSnapshot[applied={T|T < 7317515488854118400}]
I20260812 02:46:44.908684 14732 mvcc.cc:205] Tried to move back new op lower bound from 7317515488854118400 to 7317515488780791808. Current Snapshot: MvccSnapshot[applied={T|T < 7317515488854118400}]
I20260812 02:46:44.916025 13882 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:46:44.916226 13882 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:46:44.918928 13882 catalog_manager.cc:5782] T 00000000000000000000000000000000 P da13b35f9d124d078037ed8ca4d90b98: Sending DeleteTablet for 3 replicas of tablet cb5747eba92948ef896d0bb41e100c98
I20260812 02:46:44.919760 14087 tablet_service.cc:1514] Processing DeleteTablet for tablet cb5747eba92948ef896d0bb41e100c98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:46:44 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:48522
I20260812 02:46:44.919786 14566 tablet_service.cc:1514] Processing DeleteTablet for tablet cb5747eba92948ef896d0bb41e100c98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:46:44 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:53426
I20260812 02:46:44.920316 14751 tablet_replica.cc:330] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17: stopping tablet replica
I20260812 02:46:44.920346 14324 tablet_service.cc:1514] Processing DeleteTablet for tablet cb5747eba92948ef896d0bb41e100c98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:46:44 UTC) from {username='kudu', principal='kudu/127.10.75.126@KRBTEST.COM'} at 127.0.0.1:32950
I20260812 02:46:44.920710 14751 raft_consensus.cc:2229] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:46:44.920871 14753 tablet_replica.cc:330] T cb5747eba92948ef896d0bb41e100c98 P bf6720c97e00457181af3fc779ecadaa: stopping tablet replica
I20260812 02:46:44.921059 14751 raft_consensus.cc:2258] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:46:44.921445 14748 tablet_replica.cc:330] T cb5747eba92948ef896d0bb41e100c98 P eb014328e0e34c98ac46d9789c14ad03: stopping tablet replica
I20260812 02:46:44.921751 14748 raft_consensus.cc:2229] T cb5747eba92948ef896d0bb41e100c98 P eb014328e0e34c98ac46d9789c14ad03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:46:44.922305 14748 raft_consensus.cc:2258] T cb5747eba92948ef896d0bb41e100c98 P eb014328e0e34c98ac46d9789c14ad03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:46:44.923751 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 13986
I20260812 02:46:44.946266 14751 ts_tablet_manager.cc:1905] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 02:46:44.948280 13863 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.75.65:42307 (error 108)
I20260812 02:46:44.948504 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 14204
I20260812 02:46:44.957487 14699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.957029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:42307 (local address 127.0.0.1:48526)
0812 02:46:44.957275 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:44.957365 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.65:42307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
W20260812 02:46:44.957855 13863 catalog_manager.cc:4584] TS eb014328e0e34c98ac46d9789c14ad03 (127.10.75.65:42307): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cb5747eba92948ef896d0bb41e100c98: Network error: Client connection negotiation failed: client connection to 127.10.75.65:42307: connect: Connection refused (error 111)
I20260812 02:46:44.959344 14751 ts_tablet_manager.cc:1918] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:46:44.959463 14751 log.cc:1196] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/cb5747eba92948ef896d0bb41e100c98
I20260812 02:46:44.959777 14751 ts_tablet_manager.cc:1939] T cb5747eba92948ef896d0bb41e100c98 P da80bab6aa794ca8becbac14992f0e17: Deleting consensus metadata
I20260812 02:46:44.961514 13855 catalog_manager.cc:4841] TS da80bab6aa794ca8becbac14992f0e17 (127.10.75.67:44031): tablet cb5747eba92948ef896d0bb41e100c98 (table test-table [id=f2da20e8c20249e2a3b9dcef6896b1df]) successfully deleted
I20260812 02:46:44.966620 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 14446
I20260812 02:46:44.971124 14699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:44.966808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:44705 (local address 127.0.0.1:32964)
0812 02:46:44.970947 (+ 4139us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:44.971028 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.66:44705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4035}
I20260812 02:46:44.978868 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 13830
2026-08-12T02:46:44Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2671 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T02:46:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:46:45Z Disabled control of system clock
I20260812 02:46:45.021621 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:33905
--webserver_interface=127.10.75.126
--webserver_port=0
--builtin_ntp_servers=127.10.75.84:41995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:33905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 02:46:45.137715 14762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:45.138096 14762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:45.138165 14762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:45.142238 14762 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:46:45.142292 14762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:45.142306 14762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:45.142324 14762 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:46:45.142339 14762 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:46:45.147459 14762 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:41995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:33905
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:33905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14762
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:45.148497 14762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:45.149842 14762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:45.158411 14769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:45.158428 14768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:45.158427 14772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:45.158496 14762 server_base.cc:1034] running on GCE node
I20260812 02:46:45.159133 14762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:45.160180 14762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:45.161384 14762 hybrid_clock.cc:648] HybridClock initialized: now 1786502805161331 us; error 63 us; skew 500 ppm
I20260812 02:46:45.163322 14762 webserver.cc:460] Webserver started at http://127.10.75.126:37179/ using document root <none> and password file <none>
I20260812 02:46:45.163892 14762 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:45.163987 14762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:45.164232 14762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:45.166360 14762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "732722598eb5423c8416c72a0588c431"
format_stamp: "Formatted at 2026-08-12 02:46:45 on dist-test-slave-2p8l"
server_key: "77b8f8014eeb9b4ae80b8b73cc83ff1d"
server_key_iv: "973a15f7ead4df560691be9547003023"
server_key_version: "encryptionkey@0"
I20260812 02:46:45.166929 14762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "732722598eb5423c8416c72a0588c431"
format_stamp: "Formatted at 2026-08-12 02:46:45 on dist-test-slave-2p8l"
server_key: "77b8f8014eeb9b4ae80b8b73cc83ff1d"
server_key_iv: "973a15f7ead4df560691be9547003023"
server_key_version: "encryptionkey@0"
I20260812 02:46:45.170768 14762 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 02:46:45.173291 14781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:45.174597 14762 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:46:45.174789 14762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "732722598eb5423c8416c72a0588c431"
format_stamp: "Formatted at 2026-08-12 02:46:45 on dist-test-slave-2p8l"
server_key: "77b8f8014eeb9b4ae80b8b73cc83ff1d"
server_key_iv: "973a15f7ead4df560691be9547003023"
server_key_version: "encryptionkey@0"
I20260812 02:46:45.174911 14762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:45.198513 14762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:45.199251 14762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:45.199465 14762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:45.209271 14762 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:33905
I20260812 02:46:45.209298 14873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:33905 every 8 connection(s)
I20260812 02:46:45.210286 14762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:46:45.213366 14875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:45.218194 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 14762
I20260812 02:46:45.218341 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:46:45.218647 10541 external_mini_cluster.cc:1428] Setting key 5d92d22b64c1b160c221a159e6a9d537
I20260812 02:46:45.219332 14875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431: Bootstrap starting.
I20260812 02:46:45.221850 14875 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:45.222679 14875 log.cc:824] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:45.224601 14875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431: No bootstrap required, opened a new log
I20260812 02:46:45.228379 14875 raft_consensus.cc:348] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "732722598eb5423c8416c72a0588c431" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 33905 } }
I20260812 02:46:45.228619 14875 raft_consensus.cc:374] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:45.228698 14875 raft_consensus.cc:729] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 732722598eb5423c8416c72a0588c431, State: Initialized, Role: FOLLOWER
I20260812 02:46:45.228736 14881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:45.220172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56550 (local address 127.10.75.126:33905)
0812 02:46:45.220866 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:45.220881 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:45.220919 (+ 38us) server_negotiation.cc:407] Connection header received
0812 02:46:45.221605 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:45.221624 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:45.222173 (+ 549us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:45.222544 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:45.223007 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.224035 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.225114 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.225618 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.225811 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:45.226831 (+ 1020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:45.226837 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:45.226850 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:45.227260 (+ 410us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:45.227321 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:45.227343 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:45.227467 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:45.227632 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 02:46:45.227906 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":133,"threads_started":1}
I20260812 02:46:45.229192 14875 consensus_queue.cc:260] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "732722598eb5423c8416c72a0588c431" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 33905 } }
I20260812 02:46:45.229367 14875 raft_consensus.cc:388] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:46:45.229431 14875 raft_consensus.cc:482] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:46:45.229522 14875 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:45.230508 14875 raft_consensus.cc:504] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "732722598eb5423c8416c72a0588c431" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 33905 } }
I20260812 02:46:45.230882 14875 leader_election.cc:302] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 732722598eb5423c8416c72a0588c431; no voters:
I20260812 02:46:45.231225 14875 leader_election.cc:288] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:46:45.231362 14884 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:45.231621 14884 raft_consensus.cc:686] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431 [term 1 LEADER]: Becoming Leader. State: Replica: 732722598eb5423c8416c72a0588c431, State: Running, Role: LEADER
I20260812 02:46:45.231930 14884 consensus_queue.cc:237] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "732722598eb5423c8416c72a0588c431" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 33905 } }
I20260812 02:46:45.232450 14875 sys_catalog.cc:564] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:46:45.233758 14885 sys_catalog.cc:455] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "732722598eb5423c8416c72a0588c431" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "732722598eb5423c8416c72a0588c431" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 33905 } } }
I20260812 02:46:45.233747 14886 sys_catalog.cc:455] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 732722598eb5423c8416c72a0588c431. Latest consensus state: current_term: 1 leader_uuid: "732722598eb5423c8416c72a0588c431" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "732722598eb5423c8416c72a0588c431" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 33905 } } }
I20260812 02:46:45.233995 14886 sys_catalog.cc:458] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431 [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:45.234025 14885 sys_catalog.cc:458] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431 [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:45.234983 14903 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:46:45.238046 14903 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:46:45.243472 14903 catalog_manager.cc:1347] Generated new cluster ID: 2105939c6293450d8fde326903382bd2
I20260812 02:46:45.243546 14903 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:46:45.258554 14903 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:46:45.259636 14903 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:46:45.263286 14903 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431: Generated new TSK 0
I20260812 02:46:45.263900 14903 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:46:45.271355 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.65:0
--local_ip_for_outbound_sockets=127.10.75.65
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:33905
--builtin_ntp_servers=127.10.75.84:41995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 02:46:45.383657 14911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:45.383936 14911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:45.384002 14911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:45.388026 14911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:45.388106 14911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:45.388196 14911 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.65
I20260812 02:46:45.392890 14911 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:41995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.75.65
--webserver_port=0
--tserver_master_addrs=127.10.75.126:33905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.65
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:45.393972 14911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:45.395367 14911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:45.404980 14933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:45.404987 14939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:45.405023 14932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:45.405045 14911 server_base.cc:1034] running on GCE node
I20260812 02:46:45.405670 14911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:45.406374 14911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:45.407570 14911 hybrid_clock.cc:648] HybridClock initialized: now 1786502805407552 us; error 32 us; skew 500 ppm
I20260812 02:46:45.409504 14911 webserver.cc:460] Webserver started at http://127.10.75.65:46849/ using document root <none> and password file <none>
I20260812 02:46:45.410151 14911 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:45.410250 14911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:45.410491 14911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:45.412539 14911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-0/data/instance:
uuid: "07c749c48c8b4cedaf25afd75709113f"
format_stamp: "Formatted at 2026-08-12 02:46:45 on dist-test-slave-2p8l"
server_key: "643cf028e27b53a59577c44f3bbfdf2e"
server_key_iv: "50efd85e33c375c409dcfb3171bef950"
server_key_version: "encryptionkey@0"
I20260812 02:46:45.413116 14911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance:
uuid: "07c749c48c8b4cedaf25afd75709113f"
format_stamp: "Formatted at 2026-08-12 02:46:45 on dist-test-slave-2p8l"
server_key: "643cf028e27b53a59577c44f3bbfdf2e"
server_key_iv: "50efd85e33c375c409dcfb3171bef950"
server_key_version: "encryptionkey@0"
I20260812 02:46:45.416785 14911 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260812 02:46:45.419350 14954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:45.420575 14911 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:46:45.420723 14911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-0/wal
uuid: "07c749c48c8b4cedaf25afd75709113f"
format_stamp: "Formatted at 2026-08-12 02:46:45 on dist-test-slave-2p8l"
server_key: "643cf028e27b53a59577c44f3bbfdf2e"
server_key_iv: "50efd85e33c375c409dcfb3171bef950"
server_key_version: "encryptionkey@0"
I20260812 02:46:45.420841 14911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:45.440160 14911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:45.440838 14911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:45.441046 14911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:45.441646 14911 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:45.442651 14911 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:45.442732 14911 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:45.442823 14911 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:45.442876 14911 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:45.452668 14911 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.65:33691
I20260812 02:46:45.452759 15161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.65:33691 every 8 connection(s)
I20260812 02:46:45.453605 14911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-0/data/info.pb
I20260812 02:46:45.458752 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 14911
I20260812 02:46:45.458891 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-0/wal/instance
I20260812 02:46:45.459187 10541 external_mini_cluster.cc:1428] Setting key 4e16da02c851798fbf5dee651195f504
I20260812 02:46:45.461288 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.66:0
--local_ip_for_outbound_sockets=127.10.75.66
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:33905
--builtin_ntp_servers=127.10.75.84:41995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 02:46:45.463737 14881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:45.455606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.65:47891 (local address 127.10.75.126:33905)
0812 02:46:45.455769 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:45.455773 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:45.456768 (+ 995us) server_negotiation.cc:407] Connection header received
0812 02:46:45.458224 (+ 1456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:45.458226 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:45.458277 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:45.458354 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:45.459364 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.459970 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.461459 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.461771 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.461906 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:45.463178 (+ 1272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:45.463182 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:45.463184 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:45.463197 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:45.463224 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:45.463234 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:45.463319 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:45.463507 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 02:46:45.463581 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 02:46:45.464891 15170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:45.455954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:33905 (local address 127.10.75.65:47891)
0812 02:46:45.456640 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:45.456682 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:45.458002 (+ 1320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:45.458559 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:45.458566 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:45.458648 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:45.459210 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:45.459225 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.460150 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.460154 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:45.461259 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:45.461271 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.461950 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.461955 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:45.462201 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:45.462876 (+ 675us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:46:45.462878 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:45.462920 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:46:45.462988 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:45.463335 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:45.463348 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:45.463355 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 02:46:45.463498 (+ 143us) client_negotiation.cc:240] Negotiation successful
0812 02:46:45.463867 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":131,"threads_started":1}
I20260812 02:46:45.466404 15163 heartbeater.cc:347] Connected to a master server at 127.10.75.126:33905
I20260812 02:46:45.466683 15163 heartbeater.cc:464] Registering TS with master...
I20260812 02:46:45.467254 15163 heartbeater.cc:511] Master 127.10.75.126:33905 requested a full tablet report, sending...
I20260812 02:46:45.468952 14816 ts_manager.cc:194] Registered new tserver with Master: 07c749c48c8b4cedaf25afd75709113f (127.10.75.65:33691)
I20260812 02:46:45.470271 14816 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.75.65:47891
W20260812 02:46:45.574909 15171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:45.575193 15171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:45.575294 15171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:45.579505 15171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:45.579586 15171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:45.579687 15171 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.66
I20260812 02:46:45.584398 15171 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:41995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.75.66
--webserver_port=0
--tserver_master_addrs=127.10.75.126:33905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.66
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:45.585472 15171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:45.586885 15171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:45.596365 15181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:45.596450 15171 server_base.cc:1034] running on GCE node
W20260812 02:46:45.596407 15184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:45.596374 15189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:45.597003 15171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:45.597628 15171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:45.598791 15171 hybrid_clock.cc:648] HybridClock initialized: now 1786502805598759 us; error 44 us; skew 500 ppm
I20260812 02:46:45.600564 15171 webserver.cc:460] Webserver started at http://127.10.75.66:42253/ using document root <none> and password file <none>
I20260812 02:46:45.601125 15171 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:45.601197 15171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:45.601403 15171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:45.603502 15171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-1/data/instance:
uuid: "1e40d4b7a11443418deecd78c6983c01"
format_stamp: "Formatted at 2026-08-12 02:46:45 on dist-test-slave-2p8l"
server_key: "de824dc384430a065c91f552898c191f"
server_key_iv: "9a41baeab0b6d6ef148906beba8b8b64"
server_key_version: "encryptionkey@0"
I20260812 02:46:45.604075 15171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance:
uuid: "1e40d4b7a11443418deecd78c6983c01"
format_stamp: "Formatted at 2026-08-12 02:46:45 on dist-test-slave-2p8l"
server_key: "de824dc384430a065c91f552898c191f"
server_key_iv: "9a41baeab0b6d6ef148906beba8b8b64"
server_key_version: "encryptionkey@0"
I20260812 02:46:45.607738 15171 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 02:46:45.610251 15206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:45.611475 15171 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:46:45.611608 15171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-1/wal
uuid: "1e40d4b7a11443418deecd78c6983c01"
format_stamp: "Formatted at 2026-08-12 02:46:45 on dist-test-slave-2p8l"
server_key: "de824dc384430a065c91f552898c191f"
server_key_iv: "9a41baeab0b6d6ef148906beba8b8b64"
server_key_version: "encryptionkey@0"
I20260812 02:46:45.611717 15171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:45.636015 15171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:45.636703 15171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:45.636899 15171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:45.637494 15171 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:45.638451 15171 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:45.638523 15171 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:45.638592 15171 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:45.638641 15171 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:45.647807 15171 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.66:42949
I20260812 02:46:45.647832 15404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.66:42949 every 8 connection(s)
I20260812 02:46:45.648718 15171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-1/data/info.pb
I20260812 02:46:45.649315 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 15171
I20260812 02:46:45.649463 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-1/wal/instance
I20260812 02:46:45.649760 10541 external_mini_cluster.cc:1428] Setting key f4a867e9ae69202c76bbdf78a3a63335
I20260812 02:46:45.651952 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.75.67:0
--local_ip_for_outbound_sockets=127.10.75.67
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:33905
--builtin_ntp_servers=127.10.75.84:41995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 02:46:45.658864 14881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:45.650982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.66:60059 (local address 127.10.75.126:33905)
0812 02:46:45.651123 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:45.651128 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:45.652388 (+ 1260us) server_negotiation.cc:407] Connection header received
0812 02:46:45.653787 (+ 1399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:45.653790 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:45.653833 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:45.653913 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:45.655081 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.655597 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.656768 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.657001 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.657118 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:45.658305 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:45.658309 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:45.658312 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:45.658326 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:45.658353 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:45.658362 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:45.658443 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:45.658622 (+ 179us) server_negotiation.cc:299] Negotiation successful
0812 02:46:45.658716 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 02:46:45.659673 15412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:45.651493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:33905 (local address 127.10.75.66:60059)
0812 02:46:45.652227 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:45.652279 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:45.653515 (+ 1236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:45.654119 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:45.654137 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:45.654247 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:45.654932 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:45.654953 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.655721 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.655724 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:45.656615 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:45.656625 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.657167 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.657172 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:45.657334 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:45.657979 (+ 645us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:46:45.657981 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:45.658020 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:46:45.658144 (+ 124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:45.658457 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:45.658469 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:45.658475 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 02:46:45.658614 (+ 139us) client_negotiation.cc:240] Negotiation successful
0812 02:46:45.658887 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":149,"threads_started":1}
I20260812 02:46:45.660989 15405 heartbeater.cc:347] Connected to a master server at 127.10.75.126:33905
I20260812 02:46:45.661237 15405 heartbeater.cc:464] Registering TS with master...
I20260812 02:46:45.661751 15405 heartbeater.cc:511] Master 127.10.75.126:33905 requested a full tablet report, sending...
I20260812 02:46:45.662978 14816 ts_manager.cc:194] Registered new tserver with Master: 1e40d4b7a11443418deecd78c6983c01 (127.10.75.66:42949)
I20260812 02:46:45.663862 14816 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.75.66:60059
W20260812 02:46:45.767596 15413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:45.767902 15413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:45.767975 15413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:45.772504 15413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:45.772567 15413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:45.772647 15413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.75.67
I20260812 02:46:45.777431 15413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:41995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.75.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.75.67
--webserver_port=0
--tserver_master_addrs=127.10.75.126:33905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15413
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.75.67
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:45.778607 15413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:45.780030 15413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:45.789676 15430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:45.789688 15427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:45.789703 15424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:45.790050 15413 server_base.cc:1034] running on GCE node
I20260812 02:46:45.790495 15413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:45.791163 15413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:45.792351 15413 hybrid_clock.cc:648] HybridClock initialized: now 1786502805792331 us; error 25 us; skew 500 ppm
I20260812 02:46:45.794344 15413 webserver.cc:460] Webserver started at http://127.10.75.67:38895/ using document root <none> and password file <none>
I20260812 02:46:45.794878 15413 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:45.794935 15413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:45.795096 15413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:45.797062 15413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-2/data/instance:
uuid: "e6f5f645d87e4fc0b9e8cb620d7d4385"
format_stamp: "Formatted at 2026-08-12 02:46:45 on dist-test-slave-2p8l"
server_key: "84654ba6e337d470092fd084a59575c6"
server_key_iv: "9b1c05d1f34ac6dca859339e9e43cd59"
server_key_version: "encryptionkey@0"
I20260812 02:46:45.797606 15413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance:
uuid: "e6f5f645d87e4fc0b9e8cb620d7d4385"
format_stamp: "Formatted at 2026-08-12 02:46:45 on dist-test-slave-2p8l"
server_key: "84654ba6e337d470092fd084a59575c6"
server_key_iv: "9b1c05d1f34ac6dca859339e9e43cd59"
server_key_version: "encryptionkey@0"
I20260812 02:46:45.801786 15413 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 02:46:45.804291 15445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:45.805586 15413 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:46:45.805696 15413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-2/wal
uuid: "e6f5f645d87e4fc0b9e8cb620d7d4385"
format_stamp: "Formatted at 2026-08-12 02:46:45 on dist-test-slave-2p8l"
server_key: "84654ba6e337d470092fd084a59575c6"
server_key_iv: "9b1c05d1f34ac6dca859339e9e43cd59"
server_key_version: "encryptionkey@0"
I20260812 02:46:45.805787 15413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:45.845903 15413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:45.846683 15413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:45.846844 15413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:45.847506 15413 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 02:46:45.848464 15413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 02:46:45.848512 15413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:45.848551 15413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 02:46:45.848567 15413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:45.857980 15413 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.67:44191
I20260812 02:46:45.858004 15655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.67:44191 every 8 connection(s)
I20260812 02:46:45.858949 15413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-2/data/info.pb
I20260812 02:46:45.860425 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 15413
I20260812 02:46:45.860651 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-2/wal/instance
I20260812 02:46:45.860998 10541 external_mini_cluster.cc:1428] Setting key ae4f618cc91dfe5a2305faae8fbf5fec
I20260812 02:46:45.868623 14881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:45.860897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:48839 (local address 127.10.75.126:33905)
0812 02:46:45.861088 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:45.861093 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:45.862346 (+ 1253us) server_negotiation.cc:407] Connection header received
0812 02:46:45.863872 (+ 1526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:45.863875 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:45.863923 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:45.864004 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:45.864879 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.865408 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.866587 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.866841 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.866945 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:45.868082 (+ 1137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:45.868085 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:45.868088 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:45.868101 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:45.868122 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:45.868140 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:45.868209 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:45.868407 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 02:46:45.868467 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 02:46:45.869477 15661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:45.861381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:33905 (local address 127.10.75.67:48839)
0812 02:46:45.862185 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:45.862236 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:45.863663 (+ 1427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:45.864157 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:45.864164 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:45.864246 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:46:45.864734 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:45.864748 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.865544 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.865547 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:45.866455 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:45.866465 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.866987 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.866990 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:45.867139 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:45.867819 (+ 680us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 02:46:45.867821 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:46:45.867862 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 02:46:45.867924 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:46:45.868253 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:46:45.868262 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:46:45.868267 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 02:46:45.868383 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 02:46:45.868602 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":167,"threads_started":1}
I20260812 02:46:45.870675 15659 heartbeater.cc:347] Connected to a master server at 127.10.75.126:33905
I20260812 02:46:45.870922 15659 heartbeater.cc:464] Registering TS with master...
I20260812 02:46:45.871470 15659 heartbeater.cc:511] Master 127.10.75.126:33905 requested a full tablet report, sending...
I20260812 02:46:45.872633 14816 ts_manager.cc:194] Registered new tserver with Master: e6f5f645d87e4fc0b9e8cb620d7d4385 (127.10.75.67:44191)
I20260812 02:46:45.873315 14816 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.75.67:48839
I20260812 02:46:45.875272 10541 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 02:46:45.881621 14881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:45.877548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56566 (local address 127.10.75.126:33905)
0812 02:46:45.877735 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:45.877739 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:45.877837 (+ 98us) server_negotiation.cc:407] Connection header received
0812 02:46:45.877945 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:45.877947 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:45.877986 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:45.878101 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:45.878384 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.878914 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.879918 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.880131 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.880213 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:45.880993 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:45.880996 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:45.880998 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:45.881009 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:45.881026 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:45.881034 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:45.881096 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:45.881310 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 02:46:45.881404 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260812 02:46:45.884697 14816 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56566:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 02:46:45.887755 14816 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 02:46:45.903554 15682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:45.897148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46140 (local address 127.10.75.67:44191)
0812 02:46:45.897883 (+ 735us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:45.897898 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:45.898195 (+ 297us) server_negotiation.cc:407] Connection header received
0812 02:46:45.898439 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:45.898448 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:45.898653 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:45.898783 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:45.899248 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.900431 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.901815 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.902532 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.902640 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:45.902826 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:45.903255 (+ 429us) server_negotiation.cc:299] Negotiation successful
0812 02:46:45.903358 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":151,"threads_started":1}
I20260812 02:46:45.903695 15683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:45.897975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:33691 (local address 127.0.0.1:33322)
0812 02:46:45.898303 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:45.898318 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:45.898395 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:45.899138 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:45.899141 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:45.899160 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:45.899249 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:45.899255 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.900624 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.900627 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:45.902178 (+ 1551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:45.902190 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.903197 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.903203 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:45.903304 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:45.903327 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 02:46:45.903381 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 02:46:45.903508 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":198,"thread_start_us":110,"threads_started":1}
I20260812 02:46:45.903945 15677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:45.896906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.67:44191 (local address 127.0.0.1:46140)
0812 02:46:45.898078 (+ 1172us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:45.898094 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:45.898274 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:45.898955 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:45.898958 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:45.898975 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:45.899117 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:45.899124 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.900599 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.900604 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:45.901682 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:45.901693 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.902662 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.902666 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:45.902773 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:45.903060 (+ 287us) client_negotiation.cc:769] Sending connection context
0812 02:46:45.903725 (+ 665us) client_negotiation.cc:240] Negotiation successful
0812 02:46:45.903817 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1037,"mutex_wait_us":69,"thread_start_us":176,"threads_started":1}
I20260812 02:46:45.904023 15678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:45.896676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52272 (local address 127.10.75.66:42949)
0812 02:46:45.897671 (+ 995us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:45.897685 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:45.898215 (+ 530us) server_negotiation.cc:407] Connection header received
0812 02:46:45.898303 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:45.898310 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:45.898521 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:45.898699 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:45.898985 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.900456 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.902326 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.902977 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.903090 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:45.903277 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:45.903772 (+ 495us) server_negotiation.cc:299] Negotiation successful
0812 02:46:45.903873 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":868,"thread_start_us":162,"threads_started":1}
I20260812 02:46:45.904361 15681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:45.896534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:42949 (local address 127.0.0.1:52272)
0812 02:46:45.897805 (+ 1271us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:45.897855 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:45.898026 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:45.898691 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:45.898697 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:45.898720 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:45.898862 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:45.898874 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.900568 (+ 1694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.900574 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:45.902178 (+ 1604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:45.902190 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.903423 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.903426 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:45.903506 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:45.903536 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 02:46:45.903608 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 02:46:45.904238 (+ 630us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1096,"mutex_wait_us":147,"thread_start_us":1102,"threads_started":1}
I20260812 02:46:45.905004 15684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:45.898204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33322 (local address 127.10.75.65:33691)
0812 02:46:45.898715 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:45.898729 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:45.898753 (+ 24us) server_negotiation.cc:407] Connection header received
0812 02:46:45.898825 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:45.898829 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:45.898999 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:45.899149 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:45.899373 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.900538 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.902315 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.903055 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.904305 (+ 1250us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:45.904702 (+ 397us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:45.904753 (+ 51us) server_negotiation.cc:299] Negotiation successful
0812 02:46:45.904839 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":125,"threads_started":1}
I20260812 02:46:45.906942 15535 tablet_service.cc:1467] Processing CreateTablet for tablet 0ec1fe24e91244e18f9b422e5b859fae (DEFAULT_TABLE table=test-table [id=9919014b48e14592b5cefc52b0f92914]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:46:45.907578 15040 tablet_service.cc:1467] Processing CreateTablet for tablet 0ec1fe24e91244e18f9b422e5b859fae (DEFAULT_TABLE table=test-table [id=9919014b48e14592b5cefc52b0f92914]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:46:45.907577 15299 tablet_service.cc:1467] Processing CreateTablet for tablet 0ec1fe24e91244e18f9b422e5b859fae (DEFAULT_TABLE table=test-table [id=9919014b48e14592b5cefc52b0f92914]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 02:46:45.908057 15535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ec1fe24e91244e18f9b422e5b859fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:45.908582 15299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ec1fe24e91244e18f9b422e5b859fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:45.908624 15040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ec1fe24e91244e18f9b422e5b859fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:45.914577 15687 tablet_bootstrap.cc:492] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385: Bootstrap starting.
I20260812 02:46:45.916321 15692 tablet_bootstrap.cc:492] T 0ec1fe24e91244e18f9b422e5b859fae P 07c749c48c8b4cedaf25afd75709113f: Bootstrap starting.
I20260812 02:46:45.916318 15690 tablet_bootstrap.cc:492] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01: Bootstrap starting.
I20260812 02:46:45.917028 15687 tablet_bootstrap.cc:654] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:45.918008 15687 log.cc:824] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:45.918529 15690 tablet_bootstrap.cc:654] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:45.918537 15692 tablet_bootstrap.cc:654] T 0ec1fe24e91244e18f9b422e5b859fae P 07c749c48c8b4cedaf25afd75709113f: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:45.919356 15692 log.cc:824] T 0ec1fe24e91244e18f9b422e5b859fae P 07c749c48c8b4cedaf25afd75709113f: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:45.919356 15690 log.cc:824] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:45.920190 15687 tablet_bootstrap.cc:492] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385: No bootstrap required, opened a new log
I20260812 02:46:45.920392 15687 ts_tablet_manager.cc:1397] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 02:46:45.921139 15690 tablet_bootstrap.cc:492] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01: No bootstrap required, opened a new log
I20260812 02:46:45.921348 15690 ts_tablet_manager.cc:1397] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 02:46:45.921344 15692 tablet_bootstrap.cc:492] T 0ec1fe24e91244e18f9b422e5b859fae P 07c749c48c8b4cedaf25afd75709113f: No bootstrap required, opened a new log
I20260812 02:46:45.921537 15692 ts_tablet_manager.cc:1397] T 0ec1fe24e91244e18f9b422e5b859fae P 07c749c48c8b4cedaf25afd75709113f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 02:46:45.924907 15687 raft_consensus.cc:348] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e40d4b7a11443418deecd78c6983c01" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42949 } } peers { permanent_uuid: "e6f5f645d87e4fc0b9e8cb620d7d4385" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44191 } } peers { permanent_uuid: "07c749c48c8b4cedaf25afd75709113f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 33691 } }
I20260812 02:46:45.925206 15687 raft_consensus.cc:374] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:45.925266 15687 raft_consensus.cc:729] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f5f645d87e4fc0b9e8cb620d7d4385, State: Initialized, Role: FOLLOWER
I20260812 02:46:45.925625 15690 raft_consensus.cc:348] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e40d4b7a11443418deecd78c6983c01" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42949 } } peers { permanent_uuid: "e6f5f645d87e4fc0b9e8cb620d7d4385" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44191 } } peers { permanent_uuid: "07c749c48c8b4cedaf25afd75709113f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 33691 } }
I20260812 02:46:45.925786 15687 consensus_queue.cc:260] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e40d4b7a11443418deecd78c6983c01" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42949 } } peers { permanent_uuid: "e6f5f645d87e4fc0b9e8cb620d7d4385" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44191 } } peers { permanent_uuid: "07c749c48c8b4cedaf25afd75709113f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 33691 } }
I20260812 02:46:45.926033 15690 raft_consensus.cc:374] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:45.926175 15690 raft_consensus.cc:729] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e40d4b7a11443418deecd78c6983c01, State: Initialized, Role: FOLLOWER
I20260812 02:46:45.926512 15692 raft_consensus.cc:348] T 0ec1fe24e91244e18f9b422e5b859fae P 07c749c48c8b4cedaf25afd75709113f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e40d4b7a11443418deecd78c6983c01" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42949 } } peers { permanent_uuid: "e6f5f645d87e4fc0b9e8cb620d7d4385" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44191 } } peers { permanent_uuid: "07c749c48c8b4cedaf25afd75709113f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 33691 } }
I20260812 02:46:45.926756 15692 raft_consensus.cc:374] T 0ec1fe24e91244e18f9b422e5b859fae P 07c749c48c8b4cedaf25afd75709113f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:45.926816 15692 raft_consensus.cc:729] T 0ec1fe24e91244e18f9b422e5b859fae P 07c749c48c8b4cedaf25afd75709113f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07c749c48c8b4cedaf25afd75709113f, State: Initialized, Role: FOLLOWER
I20260812 02:46:45.926678 15690 consensus_queue.cc:260] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e40d4b7a11443418deecd78c6983c01" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42949 } } peers { permanent_uuid: "e6f5f645d87e4fc0b9e8cb620d7d4385" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44191 } } peers { permanent_uuid: "07c749c48c8b4cedaf25afd75709113f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 33691 } }
I20260812 02:46:45.927070 15687 ts_tablet_manager.cc:1428] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385: Time spent starting tablet: real 0.007s user 0.007s sys 0.001s
I20260812 02:46:45.927229 15692 consensus_queue.cc:260] T 0ec1fe24e91244e18f9b422e5b859fae P 07c749c48c8b4cedaf25afd75709113f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e40d4b7a11443418deecd78c6983c01" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42949 } } peers { permanent_uuid: "e6f5f645d87e4fc0b9e8cb620d7d4385" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44191 } } peers { permanent_uuid: "07c749c48c8b4cedaf25afd75709113f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 33691 } }
I20260812 02:46:45.927440 15659 heartbeater.cc:503] Master 127.10.75.126:33905 was elected leader, sending a full tablet report...
I20260812 02:46:45.928040 15690 ts_tablet_manager.cc:1428] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260812 02:46:45.928135 15692 ts_tablet_manager.cc:1428] T 0ec1fe24e91244e18f9b422e5b859fae P 07c749c48c8b4cedaf25afd75709113f: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260812 02:46:45.928411 15405 heartbeater.cc:503] Master 127.10.75.126:33905 was elected leader, sending a full tablet report...
I20260812 02:46:45.928442 15163 heartbeater.cc:503] Master 127.10.75.126:33905 was elected leader, sending a full tablet report...
I20260812 02:46:45.928705 15697 raft_consensus.cc:482] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 02:46:45.928890 15697 raft_consensus.cc:504] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e40d4b7a11443418deecd78c6983c01" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42949 } } peers { permanent_uuid: "e6f5f645d87e4fc0b9e8cb620d7d4385" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44191 } } peers { permanent_uuid: "07c749c48c8b4cedaf25afd75709113f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 33691 } }
I20260812 02:46:45.930178 15697 leader_election.cc:288] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e40d4b7a11443418deecd78c6983c01 (127.10.75.66:42949), 07c749c48c8b4cedaf25afd75709113f (127.10.75.65:33691)
I20260812 02:46:45.935134 15661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:45.930327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.66:42949 (local address 127.10.75.67:51853)
0812 02:46:45.930460 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:45.930475 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:45.930565 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:45.931578 (+ 1013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:45.931581 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:45.931598 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:45.931713 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:45.931724 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.932722 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.932725 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:45.933997 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:45.934005 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.934700 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.934704 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:45.934810 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:45.934837 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 02:46:45.934912 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 02:46:45.934988 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":23}
I20260812 02:46:45.935144 15678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:45.931119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:51853 (local address 127.10.75.66:42949)
0812 02:46:45.931333 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:45.931337 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:45.931352 (+ 15us) server_negotiation.cc:407] Connection header received
0812 02:46:45.931396 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:45.931399 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:45.931448 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:45.931555 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:45.931850 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.932605 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.934165 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.934558 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.934704 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:45.934743 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:45.934933 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 02:46:45.935011 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260812 02:46:45.935715 15328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ec1fe24e91244e18f9b422e5b859fae" candidate_uuid: "e6f5f645d87e4fc0b9e8cb620d7d4385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e40d4b7a11443418deecd78c6983c01" is_pre_election: true
I20260812 02:46:45.936024 15328 raft_consensus.cc:2454] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f5f645d87e4fc0b9e8cb620d7d4385 in term 0.
I20260812 02:46:45.936198 15684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:45.931224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.75.67:53993 (local address 127.10.75.65:33691)
0812 02:46:45.931334 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:45.931338 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:45.932280 (+ 942us) server_negotiation.cc:407] Connection header received
0812 02:46:45.932328 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:45.932330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:45.932372 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:45.932437 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 02:46:45.932965 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.933755 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.935039 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.935622 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.935717 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:45.935748 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:45.936010 (+ 262us) server_negotiation.cc:299] Negotiation successful
0812 02:46:45.936067 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 02:46:45.936209 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:45.930616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:33691 (local address 127.10.75.67:53993)
0812 02:46:45.931855 (+ 1239us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:45.931868 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 02:46:45.932015 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:46:45.932669 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:46:45.932674 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:46:45.932696 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 02:46:45.932836 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:45.932842 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.933948 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.933951 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:45.934927 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:46:45.934935 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.935768 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.935772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:46:45.935874 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:45.935898 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 02:46:45.935981 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 02:46:45.936055 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1177,"mutex_wait_us":3,"thread_start_us":93,"threads_started":1}
I20260812 02:46:45.936750 15454 leader_election.cc:302] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e40d4b7a11443418deecd78c6983c01, e6f5f645d87e4fc0b9e8cb620d7d4385; no voters:
I20260812 02:46:45.936743 15086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ec1fe24e91244e18f9b422e5b859fae" candidate_uuid: "e6f5f645d87e4fc0b9e8cb620d7d4385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07c749c48c8b4cedaf25afd75709113f" is_pre_election: true
I20260812 02:46:45.937000 15086 raft_consensus.cc:2454] T 0ec1fe24e91244e18f9b422e5b859fae P 07c749c48c8b4cedaf25afd75709113f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6f5f645d87e4fc0b9e8cb620d7d4385 in term 0.
I20260812 02:46:45.937022 15697 raft_consensus.cc:2781] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 02:46:45.937124 15697 raft_consensus.cc:482] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 02:46:45.937184 15697 raft_consensus.cc:3037] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:45.938278 15697 raft_consensus.cc:504] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e40d4b7a11443418deecd78c6983c01" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42949 } } peers { permanent_uuid: "e6f5f645d87e4fc0b9e8cb620d7d4385" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44191 } } peers { permanent_uuid: "07c749c48c8b4cedaf25afd75709113f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 33691 } }
I20260812 02:46:45.938596 15697 leader_election.cc:288] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [CANDIDATE]: Term 1 election: Requested vote from peers 1e40d4b7a11443418deecd78c6983c01 (127.10.75.66:42949), 07c749c48c8b4cedaf25afd75709113f (127.10.75.65:33691)
I20260812 02:46:45.938968 15328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ec1fe24e91244e18f9b422e5b859fae" candidate_uuid: "e6f5f645d87e4fc0b9e8cb620d7d4385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e40d4b7a11443418deecd78c6983c01"
I20260812 02:46:45.939085 15328 raft_consensus.cc:3037] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:45.939105 15086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ec1fe24e91244e18f9b422e5b859fae" candidate_uuid: "e6f5f645d87e4fc0b9e8cb620d7d4385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07c749c48c8b4cedaf25afd75709113f"
I20260812 02:46:45.939268 15086 raft_consensus.cc:3037] T 0ec1fe24e91244e18f9b422e5b859fae P 07c749c48c8b4cedaf25afd75709113f [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:45.940143 15328 raft_consensus.cc:2454] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f5f645d87e4fc0b9e8cb620d7d4385 in term 1.
I20260812 02:46:45.940384 15086 raft_consensus.cc:2454] T 0ec1fe24e91244e18f9b422e5b859fae P 07c749c48c8b4cedaf25afd75709113f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6f5f645d87e4fc0b9e8cb620d7d4385 in term 1.
I20260812 02:46:45.940428 15454 leader_election.cc:302] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e40d4b7a11443418deecd78c6983c01, e6f5f645d87e4fc0b9e8cb620d7d4385; no voters:
I20260812 02:46:45.940636 15697 raft_consensus.cc:2781] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:45.940858 15697 raft_consensus.cc:686] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [term 1 LEADER]: Becoming Leader. State: Replica: e6f5f645d87e4fc0b9e8cb620d7d4385, State: Running, Role: LEADER
I20260812 02:46:45.941175 15697 consensus_queue.cc:237] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e40d4b7a11443418deecd78c6983c01" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42949 } } peers { permanent_uuid: "e6f5f645d87e4fc0b9e8cb620d7d4385" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44191 } } peers { permanent_uuid: "07c749c48c8b4cedaf25afd75709113f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 33691 } }
I20260812 02:46:45.944460 14812 catalog_manager.cc:5495] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6f5f645d87e4fc0b9e8cb620d7d4385 (127.10.75.67). New cstate: current_term: 1 leader_uuid: "e6f5f645d87e4fc0b9e8cb620d7d4385" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e40d4b7a11443418deecd78c6983c01" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f5f645d87e4fc0b9e8cb620d7d4385" member_type: VOTER last_known_addr { host: "127.10.75.67" port: 44191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07c749c48c8b4cedaf25afd75709113f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 33691 } health_report { overall_health: UNKNOWN } } }
W20260812 02:46:45.954852 15167 tablet.cc:2369] T 0ec1fe24e91244e18f9b422e5b859fae P 07c749c48c8b4cedaf25afd75709113f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:46:45.965734 15682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:45.961960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46148 (local address 127.10.75.67:44191)
0812 02:46:45.962132 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:45.962137 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:45.962154 (+ 17us) server_negotiation.cc:407] Connection header received
0812 02:46:45.962277 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:45.962280 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:45.962333 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:45.962448 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:46:45.962733 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.963268 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.964154 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:45.964386 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:45.964509 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:45.964872 (+ 363us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:46:45.965277 (+ 405us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:46:45.965422 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:45.965498 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 02:46:45.965559 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 02:46:45.971657 15086 raft_consensus.cc:1261] T 0ec1fe24e91244e18f9b422e5b859fae P 07c749c48c8b4cedaf25afd75709113f [term 1 FOLLOWER]: Refusing update from remote peer e6f5f645d87e4fc0b9e8cb620d7d4385: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:46:45.971657 15328 raft_consensus.cc:1261] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01 [term 1 FOLLOWER]: Refusing update from remote peer e6f5f645d87e4fc0b9e8cb620d7d4385: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:46:45.972409 15697 consensus_queue.cc:1035] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07c749c48c8b4cedaf25afd75709113f" member_type: VOTER last_known_addr { host: "127.10.75.65" port: 33691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:46:45.972620 15703 consensus_queue.cc:1035] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e40d4b7a11443418deecd78c6983c01" member_type: VOTER last_known_addr { host: "127.10.75.66" port: 42949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:46:45.981447 15714 mvcc.cc:205] Tried to move back new op lower bound from 7317515493252321280 to 7317515493137817600. Current Snapshot: MvccSnapshot[applied={T|T < 7317515493252321280}]
I20260812 02:46:45.990440 14813 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56566:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:46:45.990654 14813 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56566:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 02:46:45.993317 14813 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 732722598eb5423c8416c72a0588c431: Sending DeleteTablet for 3 replicas of tablet 0ec1fe24e91244e18f9b422e5b859fae
I20260812 02:46:45.994222 15535 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ec1fe24e91244e18f9b422e5b859fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:46:45 UTC) from {username='slave'} at 127.0.0.1:46140
I20260812 02:46:45.994263 15299 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ec1fe24e91244e18f9b422e5b859fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:46:45 UTC) from {username='slave'} at 127.0.0.1:52272
I20260812 02:46:45.994360 15040 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ec1fe24e91244e18f9b422e5b859fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:46:45 UTC) from {username='slave'} at 127.0.0.1:33322
I20260812 02:46:45.994787 15735 tablet_replica.cc:330] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01: stopping tablet replica
I20260812 02:46:45.994966 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 14911
I20260812 02:46:45.998600 15735 raft_consensus.cc:2229] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 02:46:45.998924 15735 raft_consensus.cc:2258] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:46:46.005726 15735 ts_tablet_manager.cc:1905] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:46:46.008647 15732 tablet_replica.cc:330] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385: stopping tablet replica
I20260812 02:46:46.009028 15732 raft_consensus.cc:2229] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [term 1 LEADER]: Raft consensus shutting down.
I20260812 02:46:46.009657 15732 raft_consensus.cc:2258] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 02:46:46.010829 15735 ts_tablet_manager.cc:1918] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:46:46.010951 15735 log.cc:1196] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-1/wal/wals/0ec1fe24e91244e18f9b422e5b859fae
I20260812 02:46:46.011312 15735 ts_tablet_manager.cc:1939] T 0ec1fe24e91244e18f9b422e5b859fae P 1e40d4b7a11443418deecd78c6983c01: Deleting consensus metadata
I20260812 02:46:46.012090 15732 ts_tablet_manager.cc:1905] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 02:46:46.012781 14790 catalog_manager.cc:4841] TS 1e40d4b7a11443418deecd78c6983c01 (127.10.75.66:42949): tablet 0ec1fe24e91244e18f9b422e5b859fae (table test-table [id=9919014b48e14592b5cefc52b0f92914]) successfully deleted
I20260812 02:46:46.015352 15732 ts_tablet_manager.cc:1918] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 02:46:46.015467 15732 log.cc:1196] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385: Deleting WAL directory at /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786502539688512-10541-0/minicluster-data/ts-2/wal/wals/0ec1fe24e91244e18f9b422e5b859fae
I20260812 02:46:46.015821 15732 ts_tablet_manager.cc:1939] T 0ec1fe24e91244e18f9b422e5b859fae P e6f5f645d87e4fc0b9e8cb620d7d4385: Deleting consensus metadata
I20260812 02:46:46.017243 14786 catalog_manager.cc:4841] TS e6f5f645d87e4fc0b9e8cb620d7d4385 (127.10.75.67:44191): tablet 0ec1fe24e91244e18f9b422e5b859fae (table test-table [id=9919014b48e14592b5cefc52b0f92914]) successfully deleted
W20260812 02:46:46.021359 14790 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.75.65:33691 (error 108)
I20260812 02:46:46.022290 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 15171
I20260812 02:46:46.022606 15681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:46.022280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.65:33691 (local address 127.0.0.1:33332)
0812 02:46:46.022425 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 02:46:46.022503 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.65:33691: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 02:46:46.046226 14790 catalog_manager.cc:4584] TS 07c749c48c8b4cedaf25afd75709113f (127.10.75.65:33691): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0ec1fe24e91244e18f9b422e5b859fae: Network error: Client connection negotiation failed: client connection to 127.10.75.65:33691: connect: Connection refused (error 111)
I20260812 02:46:46.052825 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 15413
I20260812 02:46:46.064293 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 14762
2026-08-12T02:46:46Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1085 ms)
[----------] 6 tests from EncryptionPolicyTest (11750 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:46:46 dist-test-slave-2p8l krb5kdc[15743](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:46:46 dist-test-slave-2p8l krb5kdc[15743](info): set up 2 sockets
Aug 12 02:46:46 dist-test-slave-2p8l krb5kdc[15743](info): commencing operation
krb5kdc: starting...
W20260812 02:46:47.378958 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:46:47 dist-test-slave-2p8l krb5kdc[15743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:46:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:46:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 02:46:47.504987 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32923
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32923
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:47.616866 15767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:47.617158 15767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:47.617245 15767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:47.621254 15767 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:46:47.621333 15767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:47.621371 15767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:47.621428 15767 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:46:47.621466 15767 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:46:47.626631 15767 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32923
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:47.627661 15767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:47.628662 15767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:47.637128 15779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:47.637147 15776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:47.637128 15775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:47.637346 15767 server_base.cc:1034] running on GCE node
I20260812 02:46:47.637883 15767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:47.639011 15767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:47.640208 15767 hybrid_clock.cc:648] HybridClock initialized: now 1786502807640196 us; error 38 us; skew 500 ppm
Aug 12 02:46:47 dist-test-slave-2p8l krb5kdc[15743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502807, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:47.648311 15767 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 02:46:47.649327 15767 webserver.cc:460] Webserver started at http://127.0.0.1:36717/ using document root <none> and password file <none>
I20260812 02:46:47.649914 15767 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:47.649984 15767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:47.650219 15767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:47.652318 15767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "59a547c95215478b8f9930aec0ca6b4b"
format_stamp: "Formatted at 2026-08-12 02:46:47 on dist-test-slave-2p8l"
server_key: "a6c715eef2d35e5fa6e1324e125546b9"
server_key_iv: "0813b12b0dd57f5083652143ac1e941a"
server_key_version: "encryptionkey@0"
I20260812 02:46:47.652853 15767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "59a547c95215478b8f9930aec0ca6b4b"
format_stamp: "Formatted at 2026-08-12 02:46:47 on dist-test-slave-2p8l"
server_key: "a6c715eef2d35e5fa6e1324e125546b9"
server_key_iv: "0813b12b0dd57f5083652143ac1e941a"
server_key_version: "encryptionkey@0"
I20260812 02:46:47.656648 15767 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 02:46:47.659072 15788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:47.660401 15767 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:46:47.660619 15767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "59a547c95215478b8f9930aec0ca6b4b"
format_stamp: "Formatted at 2026-08-12 02:46:47 on dist-test-slave-2p8l"
server_key: "a6c715eef2d35e5fa6e1324e125546b9"
server_key_iv: "0813b12b0dd57f5083652143ac1e941a"
server_key_version: "encryptionkey@0"
I20260812 02:46:47.660728 15767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:47.677887 15767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:47.680822 15767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:47.681021 15767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:47.688364 15767 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32923
I20260812 02:46:47.688390 15888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32923 every 8 connection(s)
I20260812 02:46:47.689342 15767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:46:47.691485 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 15767
I20260812 02:46:47.691648 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:46:47.691959 10541 external_mini_cluster.cc:1428] Setting key 8ced3fc4d8f974758ccb1864387f6c93
I20260812 02:46:47.692322 15891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:47.698686 15891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b: Bootstrap starting.
I20260812 02:46:47.701184 15891 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b: Neither blocks nor log segments found. Creating new log.
Aug 12 02:46:47 dist-test-slave-2p8l krb5kdc[15743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 02:46:47.702005 15891 log.cc:824] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:47.704257 15891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b: No bootstrap required, opened a new log
I20260812 02:46:47.707289 15895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:47.693455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37573 (local address 127.0.0.1:32923)
0812 02:46:47.693922 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:47.693937 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:47.693974 (+ 37us) server_negotiation.cc:407] Connection header received
0812 02:46:47.694699 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:47.694715 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:47.695050 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:47.695390 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:47.696232 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:47.697312 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:47.698257 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:47.698950 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:47.699136 (+ 186us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:47.701901 (+ 2765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:47.701907 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:47.701923 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:47.701954 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:47.703918 (+ 1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:47.704509 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:47.704515 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:47.704520 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:47.704665 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:47.704994 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:47.704998 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:47.705000 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:47.705510 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:47.705720 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:47.705994 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 02:46:47.706257 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":154,"threads_started":1}
I20260812 02:46:47.708876 15891 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a547c95215478b8f9930aec0ca6b4b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32923 } }
I20260812 02:46:47.709136 15891 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:47.709203 15891 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59a547c95215478b8f9930aec0ca6b4b, State: Initialized, Role: FOLLOWER
I20260812 02:46:47.709686 15891 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a547c95215478b8f9930aec0ca6b4b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32923 } }
I20260812 02:46:47.709898 15891 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:46:47.709964 15891 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:46:47.710088 15891 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:47.710518 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:46:47.711104 15891 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a547c95215478b8f9930aec0ca6b4b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32923 } }
I20260812 02:46:47.711462 15891 leader_election.cc:302] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59a547c95215478b8f9930aec0ca6b4b; no voters:
I20260812 02:46:47.711798 15891 leader_election.cc:288] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:46:47.711871 15902 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:47.712088 15902 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b [term 1 LEADER]: Becoming Leader. State: Replica: 59a547c95215478b8f9930aec0ca6b4b, State: Running, Role: LEADER
I20260812 02:46:47.712447 15902 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a547c95215478b8f9930aec0ca6b4b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32923 } }
I20260812 02:46:47.713104 15891 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:46:47.714270 15911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59a547c95215478b8f9930aec0ca6b4b. Latest consensus state: current_term: 1 leader_uuid: "59a547c95215478b8f9930aec0ca6b4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a547c95215478b8f9930aec0ca6b4b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32923 } } }
I20260812 02:46:47.714418 15911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:47.714854 15923 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:46:47.714818 15912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59a547c95215478b8f9930aec0ca6b4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a547c95215478b8f9930aec0ca6b4b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32923 } } }
I20260812 02:46:47.714982 15912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:47.718410 15923 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:46:47.722921 15895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:47.713011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44319 (local address 127.0.0.1:32923)
0812 02:46:47.713135 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:47.713140 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:47.713327 (+ 187us) server_negotiation.cc:407] Connection header received
0812 02:46:47.713476 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:47.713479 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:47.713552 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:47.713635 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:47.714710 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:47.715482 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:47.716777 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:47.717117 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:47.717242 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:47.718986 (+ 1744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:47.718990 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:47.718993 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:47.719023 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:47.720757 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:47.721314 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:47.721320 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:47.721323 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:47.721412 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:47.721799 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:47.721805 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:47.721808 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:47.722091 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:47.722273 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:47.722674 (+ 401us) server_negotiation.cc:299] Negotiation successful
0812 02:46:47.722780 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 02:46:47.724326 15923 catalog_manager.cc:1347] Generated new cluster ID: e1b73bc9bcd746aaa71eaf35bd0fa2da
I20260812 02:46:47.724401 15923 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:46:47.732023 15923 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:46:47.732817 15923 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:46:47.736415 15923 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59a547c95215478b8f9930aec0ca6b4b: Generated new TSK 0
I20260812 02:46:47.737002 15923 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:46:47.743875 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 15767
W20260812 02:46:47.765373 15739 connection.cc:535] client connection to 127.0.0.1:32923 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:32923): Connection reset by peer (error 104)
2026-08-12T02:46:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1681 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:46:47 dist-test-slave-2p8l krb5kdc[15943](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:46:47 dist-test-slave-2p8l krb5kdc[15943](info): set up 2 sockets
Aug 12 02:46:47 dist-test-slave-2p8l krb5kdc[15943](info): commencing operation
krb5kdc: starting...
W20260812 02:46:49.083775 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.304s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:46:49 dist-test-slave-2p8l krb5kdc[15943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:46:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:46:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 02:46:49.217094 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44893
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:49.328533 15971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:49.328771 15971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:49.328814 15971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:49.332793 15971 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:46:49.332878 15971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:49.332947 15971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:49.332983 15971 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:46:49.333014 15971 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:46:49.338160 15971 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44893
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15971
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:49.339150 15971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:49.340168 15971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 02:46:49.348802 15971 server_base.cc:1034] running on GCE node
W20260812 02:46:49.348848 15984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:49.348802 15988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:49.348821 15986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:49.349571 15971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:49.350659 15971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:49.351857 15971 hybrid_clock.cc:648] HybridClock initialized: now 1786502809351830 us; error 37 us; skew 500 ppm
Aug 12 02:46:49 dist-test-slave-2p8l krb5kdc[15943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502809, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:49.354784 15971 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 02:46:49.355700 15971 webserver.cc:460] Webserver started at http://127.0.0.1:44715/ using document root <none> and password file <none>
I20260812 02:46:49.356244 15971 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:49.356336 15971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:49.356566 15971 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:49.358690 15971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "e13b262ab9994b4b980b13ca38401cea"
format_stamp: "Formatted at 2026-08-12 02:46:49 on dist-test-slave-2p8l"
server_key: "fced40820e9a1e19b41f3e0347be56ce"
server_key_iv: "a83e93925fc45c6e3642c3de70fb25c3"
server_key_version: "encryptionkey@0"
I20260812 02:46:49.359261 15971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "e13b262ab9994b4b980b13ca38401cea"
format_stamp: "Formatted at 2026-08-12 02:46:49 on dist-test-slave-2p8l"
server_key: "fced40820e9a1e19b41f3e0347be56ce"
server_key_iv: "a83e93925fc45c6e3642c3de70fb25c3"
server_key_version: "encryptionkey@0"
I20260812 02:46:49.362884 15971 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 02:46:49.365204 15998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:49.366421 15971 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260812 02:46:49.366570 15971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "e13b262ab9994b4b980b13ca38401cea"
format_stamp: "Formatted at 2026-08-12 02:46:49 on dist-test-slave-2p8l"
server_key: "fced40820e9a1e19b41f3e0347be56ce"
server_key_iv: "a83e93925fc45c6e3642c3de70fb25c3"
server_key_version: "encryptionkey@0"
I20260812 02:46:49.366680 15971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:49.383035 15971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:49.386287 15971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:49.386492 15971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:49.393760 15971 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44893
I20260812 02:46:49.393785 16090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44893 every 8 connection(s)
I20260812 02:46:49.394719 15971 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:46:49.397343 16091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:49.402806 16091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea: Bootstrap starting.
I20260812 02:46:49.403990 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 15971
I20260812 02:46:49.404135 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:46:49.404428 10541 external_mini_cluster.cc:1428] Setting key d6c76aa824b034339e3514296d947ce4
I20260812 02:46:49.405391 16091 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:49.406280 16091 log.cc:824] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:49.408070 16091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea: No bootstrap required, opened a new log
I20260812 02:46:49.410979 16091 raft_consensus.cc:348] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13b262ab9994b4b980b13ca38401cea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44893 } }
I20260812 02:46:49.411224 16091 raft_consensus.cc:374] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:49.411312 16091 raft_consensus.cc:729] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e13b262ab9994b4b980b13ca38401cea, State: Initialized, Role: FOLLOWER
I20260812 02:46:49.411783 16091 consensus_queue.cc:260] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13b262ab9994b4b980b13ca38401cea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44893 } }
I20260812 02:46:49.411949 16091 raft_consensus.cc:388] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:46:49.412038 16091 raft_consensus.cc:482] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:46:49.412166 16091 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:49.413125 16091 raft_consensus.cc:504] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13b262ab9994b4b980b13ca38401cea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44893 } }
I20260812 02:46:49.413467 16091 leader_election.cc:302] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e13b262ab9994b4b980b13ca38401cea; no voters:
I20260812 02:46:49.413748 16097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:49.405559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57641 (local address 127.0.0.1:44893)
0812 02:46:49.406001 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:49.406015 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:49.406049 (+ 34us) server_negotiation.cc:407] Connection header received
0812 02:46:49.406809 (+ 760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:49.406828 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:49.407136 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:49.407466 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:49.407871 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:49.408871 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:49.409784 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:49.410770 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:49.410958 (+ 188us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:49.411936 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:49.411942 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:49.411959 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:49.412449 (+ 490us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:49.412495 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:49.412518 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:49.412659 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:49.412819 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 02:46:49.412951 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":129,"threads_started":1}
I20260812 02:46:49.413800 16091 leader_election.cc:288] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:46:49.413899 16099 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:49.414134 16099 raft_consensus.cc:686] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea [term 1 LEADER]: Becoming Leader. State: Replica: e13b262ab9994b4b980b13ca38401cea, State: Running, Role: LEADER
I20260812 02:46:49.414469 16099 consensus_queue.cc:237] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13b262ab9994b4b980b13ca38401cea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44893 } }
I20260812 02:46:49.415062 16091 sys_catalog.cc:564] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:46:49.415674 16099 sys_catalog.cc:455] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea [sys.catalog]: SysCatalogTable state changed. Reason: New leader e13b262ab9994b4b980b13ca38401cea. Latest consensus state: current_term: 1 leader_uuid: "e13b262ab9994b4b980b13ca38401cea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13b262ab9994b4b980b13ca38401cea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44893 } } }
I20260812 02:46:49.415855 16099 sys_catalog.cc:458] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:49.416313 16113 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:46:49.416877 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:46:49.417726 16100 sys_catalog.cc:455] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e13b262ab9994b4b980b13ca38401cea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13b262ab9994b4b980b13ca38401cea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44893 } } }
I20260812 02:46:49.417829 16100 sys_catalog.cc:458] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:49.420291 16113 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:46:49.423972 16097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:49.419369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42417 (local address 127.0.0.1:44893)
0812 02:46:49.419465 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:49.419469 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:49.419482 (+ 13us) server_negotiation.cc:407] Connection header received
0812 02:46:49.419645 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:49.419648 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:49.419709 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:49.419802 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:49.420113 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:49.420887 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:49.422056 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:49.422427 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:49.422541 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:49.423470 (+ 929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:49.423474 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:49.423477 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:49.423490 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:49.423517 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:49.423530 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:49.423625 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:49.423810 (+ 185us) server_negotiation.cc:299] Negotiation successful
0812 02:46:49.423844 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 02:46:49.425824 16113 catalog_manager.cc:1347] Generated new cluster ID: 7a26391f29244939bf21402d13e8d723
I20260812 02:46:49.425887 16113 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:46:49.438290 16113 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:46:49.439529 16113 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:46:49.449187 16113 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e13b262ab9994b4b980b13ca38401cea: Generated new TSK 0
I20260812 02:46:49.449824 16113 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:46:49.459776 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 15971
W20260812 02:46:49.473439 15941 connection.cc:535] client connection to 127.0.0.1:44893 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44893): Connection reset by peer (error 104)
2026-08-12T02:46:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1708 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:46:49 dist-test-slave-2p8l krb5kdc[16146](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:46:49 dist-test-slave-2p8l krb5kdc[16146](info): set up 2 sockets
Aug 12 02:46:49 dist-test-slave-2p8l krb5kdc[16146](info): commencing operation
krb5kdc: starting...
W20260812 02:46:50.777597 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.290s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:46:50 dist-test-slave-2p8l krb5kdc[16146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:46:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:46:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 02:46:50.911680 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35773
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35773
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:51.058648 16173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:51.059073 16173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:51.059162 16173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:51.063743 16173 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:46:51.063872 16173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:51.063911 16173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:51.063951 16173 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:46:51.063987 16173 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:46:51.070463 16173 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35773
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:51.072057 16173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:51.073443 16173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:51.084100 16190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:51.084115 16187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:51.084107 16188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:51.084419 16173 server_base.cc:1034] running on GCE node
I20260812 02:46:51.085287 16173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:51.086851 16173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:51.088084 16173 hybrid_clock.cc:648] HybridClock initialized: now 1786502811088052 us; error 53 us; skew 500 ppm
Aug 12 02:46:51 dist-test-slave-2p8l krb5kdc[16146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502811, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:51.091663 16173 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 02:46:51.092902 16173 webserver.cc:460] Webserver started at http://127.0.0.1:40681/ using document root <none> and password file <none>
I20260812 02:46:51.093669 16173 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:51.093798 16173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:51.094158 16173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:51.097234 16173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "415ba20e29a946518ff575699db4f0fc"
format_stamp: "Formatted at 2026-08-12 02:46:51 on dist-test-slave-2p8l"
server_key: "c1335800d6f78bca08e9e99dbf3ed4b9"
server_key_iv: "c018b9b1b9e54e702d269aa88d97fbb8"
server_key_version: "encryptionkey@0"
I20260812 02:46:51.098029 16173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "415ba20e29a946518ff575699db4f0fc"
format_stamp: "Formatted at 2026-08-12 02:46:51 on dist-test-slave-2p8l"
server_key: "c1335800d6f78bca08e9e99dbf3ed4b9"
server_key_iv: "c018b9b1b9e54e702d269aa88d97fbb8"
server_key_version: "encryptionkey@0"
I20260812 02:46:51.103291 16173 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 02:46:51.106590 16197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:51.108282 16173 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 02:46:51.108506 16173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "415ba20e29a946518ff575699db4f0fc"
format_stamp: "Formatted at 2026-08-12 02:46:51 on dist-test-slave-2p8l"
server_key: "c1335800d6f78bca08e9e99dbf3ed4b9"
server_key_iv: "c018b9b1b9e54e702d269aa88d97fbb8"
server_key_version: "encryptionkey@0"
I20260812 02:46:51.108677 16173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:51.114774 16173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:51.118739 16173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:51.119005 16173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:51.128337 16173 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35773
I20260812 02:46:51.128399 16297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35773 every 8 connection(s)
I20260812 02:46:51.129631 16173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:46:51.132640 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 16173
I20260812 02:46:51.132825 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:46:51.133234 10541 external_mini_cluster.cc:1428] Setting key eb19722afcdda1e022c3c3b79514fe93
I20260812 02:46:51.133862 16298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:51.140008 16302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:51.135163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56409 (local address 127.0.0.1:35773)
0812 02:46:51.135740 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:51.135759 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:51.135807 (+ 48us) server_negotiation.cc:407] Connection header received
0812 02:46:51.136641 (+ 834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:51.136662 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:51.137020 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:51.137457 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:51.138489 (+ 1032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:51.138495 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:51.138509 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:51.138522 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:51.138590 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:51.138613 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:51.138803 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:51.138885 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 02:46:51.139083 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":187,"threads_started":1}
I20260812 02:46:51.142259 16298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc: Bootstrap starting.
I20260812 02:46:51.143479 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:46:51.145437 16298 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:51.146593 16298 log.cc:824] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:51.148132 16302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:51.146003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59377 (local address 127.0.0.1:35773)
0812 02:46:51.146178 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:51.146184 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:51.146492 (+ 308us) server_negotiation.cc:407] Connection header received
0812 02:46:51.146647 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:51.146650 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:51.146712 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:51.146820 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:51.147692 (+ 872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:51.147696 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:51.147699 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:51.147711 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:51.147748 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:51.147761 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:51.147857 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:51.147945 (+ 88us) server_negotiation.cc:299] Negotiation successful
0812 02:46:51.147993 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 02:46:51.149158 16298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc: No bootstrap required, opened a new log
I20260812 02:46:51.153682 16298 raft_consensus.cc:348] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415ba20e29a946518ff575699db4f0fc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35773 } }
I20260812 02:46:51.153966 16298 raft_consensus.cc:374] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:51.154006 16298 raft_consensus.cc:729] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415ba20e29a946518ff575699db4f0fc, State: Initialized, Role: FOLLOWER
I20260812 02:46:51.154534 16298 consensus_queue.cc:260] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415ba20e29a946518ff575699db4f0fc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35773 } }
I20260812 02:46:51.154721 16298 raft_consensus.cc:388] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:46:51.154810 16298 raft_consensus.cc:482] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:46:51.154958 16298 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:51.156122 16298 raft_consensus.cc:504] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415ba20e29a946518ff575699db4f0fc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35773 } }
I20260812 02:46:51.156570 16298 leader_election.cc:302] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 415ba20e29a946518ff575699db4f0fc; no voters:
I20260812 02:46:51.157021 16298 leader_election.cc:288] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:46:51.157217 16313 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:51.157481 16313 raft_consensus.cc:686] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc [term 1 LEADER]: Becoming Leader. State: Replica: 415ba20e29a946518ff575699db4f0fc, State: Running, Role: LEADER
I20260812 02:46:51.158006 16313 consensus_queue.cc:237] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415ba20e29a946518ff575699db4f0fc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35773 } }
I20260812 02:46:51.158905 16298 sys_catalog.cc:564] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:46:51.160333 16315 sys_catalog.cc:455] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 415ba20e29a946518ff575699db4f0fc. Latest consensus state: current_term: 1 leader_uuid: "415ba20e29a946518ff575699db4f0fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415ba20e29a946518ff575699db4f0fc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35773 } } }
I20260812 02:46:51.160388 16314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "415ba20e29a946518ff575699db4f0fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415ba20e29a946518ff575699db4f0fc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35773 } } }
I20260812 02:46:51.160485 16315 sys_catalog.cc:458] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:51.160490 16314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:51.160989 16329 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:46:51.165171 16329 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:46:51.172822 16329 catalog_manager.cc:1347] Generated new cluster ID: c3799e96772747c491d47a133f3e077a
I20260812 02:46:51.173027 16329 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:46:51.189867 16329 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:46:51.190483 16329 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:46:51.195873 16329 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 415ba20e29a946518ff575699db4f0fc: Generated new TSK 0
I20260812 02:46:51.196874 16329 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:46:51.201468 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 16173
2026-08-12T02:46:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1748 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:46:51 dist-test-slave-2p8l krb5kdc[16350](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:46:51 dist-test-slave-2p8l krb5kdc[16350](info): set up 2 sockets
Aug 12 02:46:51 dist-test-slave-2p8l krb5kdc[16350](info): commencing operation
krb5kdc: starting...
W20260812 02:46:52.530781 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:46:52 dist-test-slave-2p8l krb5kdc[16350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:46:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:46:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 02:46:52.660921 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32903
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32903
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:52.793962 16369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:52.794354 16369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:52.794402 16369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:52.798910 16369 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:46:52.798976 16369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:52.799000 16369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:52.799018 16369 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:46:52.799068 16369 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:46:52.805158 16369 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32903
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:52.806447 16369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:52.807639 16369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:52.817448 16381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:52.817442 16379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:52.817467 16377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:52.817734 16369 server_base.cc:1034] running on GCE node
I20260812 02:46:52.818436 16369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:52.819767 16369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:52.820988 16369 hybrid_clock.cc:648] HybridClock initialized: now 1786502812820971 us; error 29 us; skew 500 ppm
Aug 12 02:46:52 dist-test-slave-2p8l krb5kdc[16350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502812, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:52.827521 16369 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 02:46:52.828567 16369 webserver.cc:460] Webserver started at http://127.0.0.1:41377/ using document root <none> and password file <none>
I20260812 02:46:52.829190 16369 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:52.829283 16369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:52.829523 16369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:52.831884 16369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "32d9c705f9db4d06a5b1429b5aa2de00"
format_stamp: "Formatted at 2026-08-12 02:46:52 on dist-test-slave-2p8l"
server_key: "1cce35a8695342c65bc6dcc3669379e9"
server_key_iv: "e4f5d0b030b2958256576e1e5426d6d0"
server_key_version: "encryptionkey@0"
I20260812 02:46:52.832520 16369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "32d9c705f9db4d06a5b1429b5aa2de00"
format_stamp: "Formatted at 2026-08-12 02:46:52 on dist-test-slave-2p8l"
server_key: "1cce35a8695342c65bc6dcc3669379e9"
server_key_iv: "e4f5d0b030b2958256576e1e5426d6d0"
server_key_version: "encryptionkey@0"
I20260812 02:46:52.836905 16369 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 02:46:52.839874 16389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:52.841264 16369 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 02:46:52.841431 16369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "32d9c705f9db4d06a5b1429b5aa2de00"
format_stamp: "Formatted at 2026-08-12 02:46:52 on dist-test-slave-2p8l"
server_key: "1cce35a8695342c65bc6dcc3669379e9"
server_key_iv: "e4f5d0b030b2958256576e1e5426d6d0"
server_key_version: "encryptionkey@0"
I20260812 02:46:52.841560 16369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:52.857898 16369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:52.861246 16369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:52.861462 16369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:52.869097 16369 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32903
I20260812 02:46:52.869133 16502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32903 every 8 connection(s)
I20260812 02:46:52.870167 16369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:46:52.873287 16503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:52.879176 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 16369
I20260812 02:46:52.879331 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:46:52.879437 16503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00: Bootstrap starting.
I20260812 02:46:52.879673 10541 external_mini_cluster.cc:1428] Setting key 36e41f82437968ec71ecf6e94cb953c3
I20260812 02:46:52.882304 16503 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:52.883126 16503 log.cc:824] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:52.885166 16503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00: No bootstrap required, opened a new log
Aug 12 02:46:52 dist-test-slave-2p8l krb5kdc[16350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 02:46:52.889583 16503 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d9c705f9db4d06a5b1429b5aa2de00" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32903 } }
I20260812 02:46:52.889825 16503 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:52.889887 16503 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d9c705f9db4d06a5b1429b5aa2de00, State: Initialized, Role: FOLLOWER
I20260812 02:46:52.890414 16503 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d9c705f9db4d06a5b1429b5aa2de00" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32903 } }
I20260812 02:46:52.890552 16503 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:46:52.890645 16503 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:46:52.890760 16503 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:52.891724 16503 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d9c705f9db4d06a5b1429b5aa2de00" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32903 } }
I20260812 02:46:52.892168 16503 leader_election.cc:302] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32d9c705f9db4d06a5b1429b5aa2de00; no voters:
I20260812 02:46:52.892611 16503 leader_election.cc:288] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:46:52.892724 16509 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:52.892966 16509 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00 [term 1 LEADER]: Becoming Leader. State: Replica: 32d9c705f9db4d06a5b1429b5aa2de00, State: Running, Role: LEADER
I20260812 02:46:52.893306 16509 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d9c705f9db4d06a5b1429b5aa2de00" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32903 } }
I20260812 02:46:52.894137 16503 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:46:52.895169 16510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32d9c705f9db4d06a5b1429b5aa2de00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d9c705f9db4d06a5b1429b5aa2de00" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32903 } } }
I20260812 02:46:52.895298 16510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00 [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:52.895578 16507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:52.881146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55475 (local address 127.0.0.1:32903)
0812 02:46:52.881594 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:52.881610 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:52.881655 (+ 45us) server_negotiation.cc:407] Connection header received
0812 02:46:52.882449 (+ 794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:52.882470 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:52.882836 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:52.883187 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:52.884077 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:52.885085 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:52.886000 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:52.886534 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:52.886727 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:52.889672 (+ 2945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:52.889678 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:52.889692 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:52.889721 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:52.891832 (+ 2111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:52.892439 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:52.892447 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:52.892458 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:52.892618 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:52.893026 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:52.893029 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:52.893031 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:52.893541 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:52.893744 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:52.894118 (+ 374us) server_negotiation.cc:299] Negotiation successful
0812 02:46:52.894441 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":128,"threads_started":1}
I20260812 02:46:52.895927 16511 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32d9c705f9db4d06a5b1429b5aa2de00. Latest consensus state: current_term: 1 leader_uuid: "32d9c705f9db4d06a5b1429b5aa2de00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32d9c705f9db4d06a5b1429b5aa2de00" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32903 } } }
I20260812 02:46:52.896080 16511 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00 [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:52.896898 16524 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:46:52.898896 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:46:52.900277 16524 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:46:52.907456 16524 catalog_manager.cc:1347] Generated new cluster ID: d4bf5ce5d59b47c7a1ed3b9caac202e1
I20260812 02:46:52.907531 16524 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:46:52.910283 16507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:52.901457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59715 (local address 127.0.0.1:32903)
0812 02:46:52.901562 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:52.901566 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:52.901918 (+ 352us) server_negotiation.cc:407] Connection header received
0812 02:46:52.902033 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:52.902038 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:52.902115 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:52.902202 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:52.902941 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:52.903460 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:52.904283 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:52.904546 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:52.904662 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:52.906562 (+ 1900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:52.906568 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:52.906571 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:52.906599 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:52.908380 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:52.908878 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:52.908882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:52.908884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:52.908983 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:52.909278 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:52.909282 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:52.909284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:52.909533 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:52.909673 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:52.909959 (+ 286us) server_negotiation.cc:299] Negotiation successful
0812 02:46:52.910121 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 02:46:52.924322 16524 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:46:52.925688 16524 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:46:52.947587 16524 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32d9c705f9db4d06a5b1429b5aa2de00: Generated new TSK 0
I20260812 02:46:52.948405 16524 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:46:52.960354 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 16369
2026-08-12T02:46:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1754 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:46:53 dist-test-slave-2p8l krb5kdc[16553](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:46:53 dist-test-slave-2p8l krb5kdc[16553](info): set up 2 sockets
Aug 12 02:46:53 dist-test-slave-2p8l krb5kdc[16553](info): commencing operation
krb5kdc: starting...
W20260812 02:46:54.286209 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.294s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:46:54 dist-test-slave-2p8l krb5kdc[16553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:46:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:46:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 02:46:54.415577 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42393
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42393
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:54.530215 16572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:54.530469 16572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:54.530510 16572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:54.534698 16572 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:46:54.534763 16572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:54.534783 16572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:54.534801 16572 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:46:54.534816 16572 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:46:54.540140 16572 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42393
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:54.541271 16572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:54.542373 16572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 02:46:54.551158 16572 server_base.cc:1034] running on GCE node
W20260812 02:46:54.551103 16581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:54.551084 16587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:54.551137 16580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:54.552083 16572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:54.553239 16572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:54.554450 16572 hybrid_clock.cc:648] HybridClock initialized: now 1786502814554421 us; error 43 us; skew 500 ppm
Aug 12 02:46:54 dist-test-slave-2p8l krb5kdc[16553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502814, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:54.557250 16572 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 02:46:54.558275 16572 webserver.cc:460] Webserver started at http://127.0.0.1:35545/ using document root <none> and password file <none>
I20260812 02:46:54.558863 16572 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:54.558962 16572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:54.559206 16572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:54.561266 16572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "253da55e713c40efad4555f5c12e985b"
format_stamp: "Formatted at 2026-08-12 02:46:54 on dist-test-slave-2p8l"
server_key: "65219e0612f01b3fa194663b6748652b"
server_key_iv: "cabc1d1bec56a93181ae718e652640a1"
server_key_version: "encryptionkey@0"
I20260812 02:46:54.561892 16572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "253da55e713c40efad4555f5c12e985b"
format_stamp: "Formatted at 2026-08-12 02:46:54 on dist-test-slave-2p8l"
server_key: "65219e0612f01b3fa194663b6748652b"
server_key_iv: "cabc1d1bec56a93181ae718e652640a1"
server_key_version: "encryptionkey@0"
I20260812 02:46:54.565730 16572 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 02:46:54.568424 16600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:54.569658 16572 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260812 02:46:54.569814 16572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "253da55e713c40efad4555f5c12e985b"
format_stamp: "Formatted at 2026-08-12 02:46:54 on dist-test-slave-2p8l"
server_key: "65219e0612f01b3fa194663b6748652b"
server_key_iv: "cabc1d1bec56a93181ae718e652640a1"
server_key_version: "encryptionkey@0"
I20260812 02:46:54.569931 16572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:54.587855 16572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:54.590966 16572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:54.591213 16572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:54.598771 16572 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42393
I20260812 02:46:54.598799 16707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42393 every 8 connection(s)
I20260812 02:46:54.599753 16572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:46:54.602357 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 16572
I20260812 02:46:54.602532 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:46:54.602720 16708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:54.602880 10541 external_mini_cluster.cc:1428] Setting key 4f0bb42c38da31158bbe4c114d624f01
I20260812 02:46:54.610229 16708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b: Bootstrap starting.
I20260812 02:46:54.613067 16708 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:54.613392 16713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:54.604449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37289 (local address 127.0.0.1:42393)
0812 02:46:54.604936 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:54.604956 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:54.605002 (+ 46us) server_negotiation.cc:407] Connection header received
0812 02:46:54.605701 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:54.605726 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:54.606198 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:54.606577 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:54.607012 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:54.608483 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:54.609408 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:54.610124 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:54.610295 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:54.611282 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:54.611288 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:54.611304 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:54.611850 (+ 546us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:54.611919 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:54.611949 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:54.612050 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:54.612214 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 02:46:54.612420 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":136,"threads_started":1}
I20260812 02:46:54.613929 16708 log.cc:824] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:54.616289 16708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b: No bootstrap required, opened a new log
I20260812 02:46:54.616662 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:46:54.620198 16708 raft_consensus.cc:348] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "253da55e713c40efad4555f5c12e985b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42393 } }
I20260812 02:46:54.620440 16708 raft_consensus.cc:374] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:54.620522 16708 raft_consensus.cc:729] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 253da55e713c40efad4555f5c12e985b, State: Initialized, Role: FOLLOWER
I20260812 02:46:54.620972 16708 consensus_queue.cc:260] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "253da55e713c40efad4555f5c12e985b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42393 } }
I20260812 02:46:54.621130 16708 raft_consensus.cc:388] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:46:54.621202 16708 raft_consensus.cc:482] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:46:54.621477 16708 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:54.622706 16708 raft_consensus.cc:504] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "253da55e713c40efad4555f5c12e985b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42393 } }
I20260812 02:46:54.622938 16713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:54.618788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59313 (local address 127.0.0.1:42393)
0812 02:46:54.618921 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:54.618927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:54.619134 (+ 207us) server_negotiation.cc:407] Connection header received
0812 02:46:54.619287 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:54.619291 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:54.619338 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:54.619425 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:54.619699 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:54.620201 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:54.621128 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:54.621418 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:54.621543 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:54.622465 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:54.622469 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:54.622472 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:54.622484 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:54.622514 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:54.622527 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:54.622626 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:54.622749 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 02:46:54.622803 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 02:46:54.623106 16708 leader_election.cc:302] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 253da55e713c40efad4555f5c12e985b; no voters:
I20260812 02:46:54.623467 16708 leader_election.cc:288] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:46:54.623546 16723 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:54.623821 16723 raft_consensus.cc:686] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b [term 1 LEADER]: Becoming Leader. State: Replica: 253da55e713c40efad4555f5c12e985b, State: Running, Role: LEADER
I20260812 02:46:54.624195 16723 consensus_queue.cc:237] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "253da55e713c40efad4555f5c12e985b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42393 } }
I20260812 02:46:54.624787 16708 sys_catalog.cc:564] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:46:54.625442 16723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 253da55e713c40efad4555f5c12e985b. Latest consensus state: current_term: 1 leader_uuid: "253da55e713c40efad4555f5c12e985b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "253da55e713c40efad4555f5c12e985b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42393 } } }
I20260812 02:46:54.625658 16723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:54.625916 16725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "253da55e713c40efad4555f5c12e985b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "253da55e713c40efad4555f5c12e985b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42393 } } }
I20260812 02:46:54.626149 16733 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:46:54.626132 16725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:54.629416 16733 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:46:54.635587 16733 catalog_manager.cc:1347] Generated new cluster ID: d97c3d1b0be7419eaf98e8cabac68ae9
I20260812 02:46:54.635659 16733 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:46:54.644404 16733 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:46:54.645339 16733 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:46:54.649726 16733 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 253da55e713c40efad4555f5c12e985b: Generated new TSK 0
I20260812 02:46:54.650489 16733 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:46:54.657966 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 16572
2026-08-12T02:46:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1700 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:46:54 dist-test-slave-2p8l krb5kdc[16751](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:46:54 dist-test-slave-2p8l krb5kdc[16751](info): set up 2 sockets
Aug 12 02:46:54 dist-test-slave-2p8l krb5kdc[16751](info): commencing operation
krb5kdc: starting...
W20260812 02:46:55.965919 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:46:56 dist-test-slave-2p8l krb5kdc[16751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:46:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:46:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 02:46:56.094666 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38077
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38077
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:56.207600 16777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:56.207856 16777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:56.207932 16777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:56.211983 16777 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:46:56.212039 16777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:56.212059 16777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:56.212121 16777 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:46:56.212157 16777 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:46:56.217350 16777 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38077
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16777
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:56.218392 16777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:56.219406 16777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:56.228046 16788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:56.228191 16777 server_base.cc:1034] running on GCE node
W20260812 02:46:56.228075 16787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:56.228428 16798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:56.228953 16777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:56.230124 16777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:56.231340 16777 hybrid_clock.cc:648] HybridClock initialized: now 1786502816231309 us; error 38 us; skew 500 ppm
Aug 12 02:46:56 dist-test-slave-2p8l krb5kdc[16751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502816, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:56.234320 16777 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 02:46:56.235160 16777 webserver.cc:460] Webserver started at http://127.0.0.1:42617/ using document root <none> and password file <none>
I20260812 02:46:56.235672 16777 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:56.235733 16777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:56.235931 16777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:56.237919 16777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "bb143c94158a45eeb01672a60a46a39e"
format_stamp: "Formatted at 2026-08-12 02:46:56 on dist-test-slave-2p8l"
server_key: "b8e8f7ce5c5fc6c3982443fde0624904"
server_key_iv: "e47e3e72ad508e6469425fbba02902da"
server_key_version: "encryptionkey@0"
I20260812 02:46:56.238521 16777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "bb143c94158a45eeb01672a60a46a39e"
format_stamp: "Formatted at 2026-08-12 02:46:56 on dist-test-slave-2p8l"
server_key: "b8e8f7ce5c5fc6c3982443fde0624904"
server_key_iv: "e47e3e72ad508e6469425fbba02902da"
server_key_version: "encryptionkey@0"
I20260812 02:46:56.242134 16777 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 02:46:56.244437 16811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:56.245654 16777 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:46:56.245788 16777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "bb143c94158a45eeb01672a60a46a39e"
format_stamp: "Formatted at 2026-08-12 02:46:56 on dist-test-slave-2p8l"
server_key: "b8e8f7ce5c5fc6c3982443fde0624904"
server_key_iv: "e47e3e72ad508e6469425fbba02902da"
server_key_version: "encryptionkey@0"
I20260812 02:46:56.245886 16777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:56.250329 16777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:56.253787 16777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:56.254019 16777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:56.263379 16777 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38077
I20260812 02:46:56.263440 16910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38077 every 8 connection(s)
I20260812 02:46:56.264247 16777 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:46:56.266975 16912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:56.271602 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 16777
I20260812 02:46:56.271756 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:46:56.272058 10541 external_mini_cluster.cc:1428] Setting key 92c2dde47675ece9b20e69d7ca48632e
I20260812 02:46:56.272734 16912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e: Bootstrap starting.
I20260812 02:46:56.275174 16912 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:56.276103 16912 log.cc:824] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:56.277758 16916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:56.273706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57845 (local address 127.0.0.1:38077)
0812 02:46:56.274239 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:56.274254 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:56.274290 (+ 36us) server_negotiation.cc:407] Connection header received
0812 02:46:56.274894 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:56.274909 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:56.275183 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:56.275502 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:56.276355 (+ 853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:56.276360 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:56.276371 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:56.276381 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:56.276436 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:56.276455 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:56.276637 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:56.276708 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 02:46:56.276887 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":151,"threads_started":1}
I20260812 02:46:56.278321 16912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e: No bootstrap required, opened a new log
I20260812 02:46:56.280398 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:46:56.282465 16912 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb143c94158a45eeb01672a60a46a39e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38077 } }
I20260812 02:46:56.282739 16912 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:56.282792 16912 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb143c94158a45eeb01672a60a46a39e, State: Initialized, Role: FOLLOWER
I20260812 02:46:56.283262 16912 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb143c94158a45eeb01672a60a46a39e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38077 } }
I20260812 02:46:56.283457 16912 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:46:56.283528 16912 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:46:56.283641 16912 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:56.284529 16916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:56.282824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54167 (local address 127.0.0.1:38077)
0812 02:46:56.282928 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:56.282932 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:56.283196 (+ 264us) server_negotiation.cc:407] Connection header received
0812 02:46:56.283293 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:56.283295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:56.283322 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:56.283385 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:56.284107 (+ 722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:56.284110 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:56.284112 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:56.284122 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:56.284145 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:56.284154 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:56.284231 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:56.284336 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 02:46:56.284368 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 02:46:56.284860 16912 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb143c94158a45eeb01672a60a46a39e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38077 } }
I20260812 02:46:56.285203 16912 leader_election.cc:302] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb143c94158a45eeb01672a60a46a39e; no voters:
I20260812 02:46:56.285513 16912 leader_election.cc:288] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:46:56.285678 16924 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:56.285980 16924 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e [term 1 LEADER]: Becoming Leader. State: Replica: bb143c94158a45eeb01672a60a46a39e, State: Running, Role: LEADER
I20260812 02:46:56.286338 16924 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb143c94158a45eeb01672a60a46a39e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38077 } }
I20260812 02:46:56.286736 16912 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:46:56.287956 16926 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb143c94158a45eeb01672a60a46a39e. Latest consensus state: current_term: 1 leader_uuid: "bb143c94158a45eeb01672a60a46a39e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb143c94158a45eeb01672a60a46a39e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38077 } } }
I20260812 02:46:56.288091 16926 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:56.288424 16925 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb143c94158a45eeb01672a60a46a39e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb143c94158a45eeb01672a60a46a39e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38077 } } }
I20260812 02:46:56.288476 16936 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:46:56.288558 16925 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:56.291519 16936 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:46:56.296620 16936 catalog_manager.cc:1347] Generated new cluster ID: 8d922cead3bf42e895bebf2d188dad27
I20260812 02:46:56.296695 16936 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:46:56.306186 16936 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:46:56.306469 16936 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:46:56.313640 16936 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb143c94158a45eeb01672a60a46a39e: Generated new TSK 0
I20260812 02:46:56.314245 16936 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:46:56.319613 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 16777
2026-08-12T02:46:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1664 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:46:56 dist-test-slave-2p8l krb5kdc[16959](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:46:56 dist-test-slave-2p8l krb5kdc[16959](info): set up 2 sockets
Aug 12 02:46:56 dist-test-slave-2p8l krb5kdc[16959](info): commencing operation
krb5kdc: starting...
W20260812 02:46:57.695000 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.338s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:46:57 dist-test-slave-2p8l krb5kdc[16959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:46:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:46:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 02:46:57.822899 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46347
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:57.935279 16975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:57.935590 16975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:57.935673 16975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:57.939674 16975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:46:57.939767 16975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:57.939806 16975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:57.939867 16975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:46:57.939905 16975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:46:57.945755 16975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46347
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16975
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:57.946842 16975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:57.947875 16975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:57.956522 16991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:57.956718 16975 server_base.cc:1034] running on GCE node
W20260812 02:46:57.956517 16999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:57.956511 16992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:57.957566 16975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:57.958837 16975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:57.960014 16975 hybrid_clock.cc:648] HybridClock initialized: now 1786502817959971 us; error 59 us; skew 500 ppm
Aug 12 02:46:57 dist-test-slave-2p8l krb5kdc[16959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502817, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:57.967715 16975 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 02:46:57.968686 16975 webserver.cc:460] Webserver started at http://127.0.0.1:44827/ using document root <none> and password file <none>
I20260812 02:46:57.969363 16975 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:57.969434 16975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:57.969733 16975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:57.971890 16975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "f1ef89df45f64f479d2bf2d032a80434"
format_stamp: "Formatted at 2026-08-12 02:46:57 on dist-test-slave-2p8l"
server_key: "8732bb3fb1b46ec7f0fe18caa8679dc6"
server_key_iv: "4c47b0db9df1f5e5e07b521d9ebaf640"
server_key_version: "encryptionkey@0"
I20260812 02:46:57.972481 16975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "f1ef89df45f64f479d2bf2d032a80434"
format_stamp: "Formatted at 2026-08-12 02:46:57 on dist-test-slave-2p8l"
server_key: "8732bb3fb1b46ec7f0fe18caa8679dc6"
server_key_iv: "4c47b0db9df1f5e5e07b521d9ebaf640"
server_key_version: "encryptionkey@0"
I20260812 02:46:57.977285 16975 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 02:46:57.979826 17011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:57.981068 16975 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:46:57.981223 16975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "f1ef89df45f64f479d2bf2d032a80434"
format_stamp: "Formatted at 2026-08-12 02:46:57 on dist-test-slave-2p8l"
server_key: "8732bb3fb1b46ec7f0fe18caa8679dc6"
server_key_iv: "4c47b0db9df1f5e5e07b521d9ebaf640"
server_key_version: "encryptionkey@0"
I20260812 02:46:57.981349 16975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:57.991412 16975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:57.994267 16975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:57.994470 16975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:58.001782 16975 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46347
I20260812 02:46:58.001807 17104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46347 every 8 connection(s)
I20260812 02:46:58.002807 16975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:46:58.005475 17105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:58.009720 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 16975
I20260812 02:46:58.009866 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:46:58.010185 10541 external_mini_cluster.cc:1428] Setting key ad1891159b9e44eddad432e0824db7ec
I20260812 02:46:58.011570 17105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434: Bootstrap starting.
I20260812 02:46:58.013897 17105 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:58.014675 17105 log.cc:824] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:58.016605 17105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434: No bootstrap required, opened a new log
Aug 12 02:46:58 dist-test-slave-2p8l krb5kdc[16959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 02:46:58.020387 17105 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1ef89df45f64f479d2bf2d032a80434" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46347 } }
I20260812 02:46:58.020668 17105 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:58.020754 17105 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1ef89df45f64f479d2bf2d032a80434, State: Initialized, Role: FOLLOWER
I20260812 02:46:58.021226 17105 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1ef89df45f64f479d2bf2d032a80434" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46347 } }
I20260812 02:46:58.021354 17105 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:46:58.021458 17105 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:46:58.021571 17105 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:58.022714 17105 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1ef89df45f64f479d2bf2d032a80434" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46347 } }
I20260812 02:46:58.023079 17105 leader_election.cc:302] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1ef89df45f64f479d2bf2d032a80434; no voters:
I20260812 02:46:58.023463 17105 leader_election.cc:288] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:46:58.023552 17118 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:58.023800 17118 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434 [term 1 LEADER]: Becoming Leader. State: Replica: f1ef89df45f64f479d2bf2d032a80434, State: Running, Role: LEADER
I20260812 02:46:58.024129 17118 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1ef89df45f64f479d2bf2d032a80434" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46347 } }
I20260812 02:46:58.024703 17105 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:46:58.025445 17118 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1ef89df45f64f479d2bf2d032a80434. Latest consensus state: current_term: 1 leader_uuid: "f1ef89df45f64f479d2bf2d032a80434" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1ef89df45f64f479d2bf2d032a80434" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46347 } } }
I20260812 02:46:58.025563 17118 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434 [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:58.026017 17109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:58.011705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:43789 (local address 127.0.0.1:46347)
0812 02:46:58.012136 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:58.012151 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:58.012189 (+ 38us) server_negotiation.cc:407] Connection header received
0812 02:46:58.012876 (+ 687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:58.012893 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:58.013228 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:58.013558 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:58.014444 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:58.015712 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:58.016571 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:58.017087 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:58.017264 (+ 177us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:58.019876 (+ 2612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:58.019881 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:58.019894 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:58.019921 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:58.022004 (+ 2083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:58.022631 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:58.022636 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:58.022640 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:58.022753 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:58.023137 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:58.023140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:58.023141 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:58.023683 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:58.024655 (+ 972us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:58.024832 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 02:46:58.025052 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":124,"threads_started":1}
I20260812 02:46:58.026024 17120 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1ef89df45f64f479d2bf2d032a80434" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1ef89df45f64f479d2bf2d032a80434" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46347 } } }
I20260812 02:46:58.026185 17120 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434 [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:58.027122 17134 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:46:58.029652 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:46:58.030258 17134 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:46:58.036348 17134 catalog_manager.cc:1347] Generated new cluster ID: d826bb2a890f48299aa94a5f2f13565d
I20260812 02:46:58.036420 17134 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:46:58.040480 17109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:58.032060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:46485 (local address 127.0.0.1:46347)
0812 02:46:58.032189 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:58.032195 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:58.032365 (+ 170us) server_negotiation.cc:407] Connection header received
0812 02:46:58.032516 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:58.032520 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:58.032565 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:58.032661 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:58.033309 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:58.033825 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:58.034711 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:58.035019 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:58.035134 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:58.036898 (+ 1764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:58.036902 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:58.036905 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:46:58.036930 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:58.038628 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:58.039185 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:58.039188 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:58.039190 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:58.039270 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:46:58.039625 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:46:58.039628 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:46:58.039630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:46:58.039810 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:58.039932 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:58.040237 (+ 305us) server_negotiation.cc:299] Negotiation successful
0812 02:46:58.040325 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 02:46:58.076959 17134 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:46:58.078298 17134 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:46:58.083557 17134 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1ef89df45f64f479d2bf2d032a80434: Generated new TSK 0
I20260812 02:46:58.084348 17134 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:46:58.095547 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 16975
W20260812 02:46:58.112850 16954 connection.cc:535] client connection to 127.0.0.1:46347 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46347): Connection reset by peer (error 104)
2026-08-12T02:46:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1770 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:46:58 dist-test-slave-2p8l krb5kdc[17166](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:46:58 dist-test-slave-2p8l krb5kdc[17166](info): set up 2 sockets
Aug 12 02:46:58 dist-test-slave-2p8l krb5kdc[17166](info): commencing operation
krb5kdc: starting...
W20260812 02:46:59.489113 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.362s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:46:59 dist-test-slave-2p8l krb5kdc[17166](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502819, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:46:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:46:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 02:46:59.617655 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42575
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42575
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:46:59.728340 17198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:46:59.728644 17198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:46:59.728736 17198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:46:59.732800 17198 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:46:59.732894 17198 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:46:59.732935 17198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:46:59.732995 17198 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:46:59.733036 17198 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:46:59.738315 17198 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42575
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42575
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17198
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:46:59.739356 17198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:46:59.740401 17198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:46:59.748703 17215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:59.748728 17207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:46:59.748728 17211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:46:59.749106 17198 server_base.cc:1034] running on GCE node
I20260812 02:46:59.749588 17198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:46:59.750677 17198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:46:59.751889 17198 hybrid_clock.cc:648] HybridClock initialized: now 1786502819751868 us; error 33 us; skew 500 ppm
Aug 12 02:46:59 dist-test-slave-2p8l krb5kdc[17166](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502819, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:46:59.754985 17198 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 02:46:59.755929 17198 webserver.cc:460] Webserver started at http://127.0.0.1:36895/ using document root <none> and password file <none>
I20260812 02:46:59.756495 17198 fs_manager.cc:359] Metadata directory not provided
I20260812 02:46:59.756594 17198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:46:59.756819 17198 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:46:59.758920 17198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "9fec36c1886747488310458b4216b779"
format_stamp: "Formatted at 2026-08-12 02:46:59 on dist-test-slave-2p8l"
server_key: "c5f54d7252806781bd79956413fed409"
server_key_iv: "555bcb80eb98f656c611782591388684"
server_key_version: "encryptionkey@0"
I20260812 02:46:59.759507 17198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "9fec36c1886747488310458b4216b779"
format_stamp: "Formatted at 2026-08-12 02:46:59 on dist-test-slave-2p8l"
server_key: "c5f54d7252806781bd79956413fed409"
server_key_iv: "555bcb80eb98f656c611782591388684"
server_key_version: "encryptionkey@0"
I20260812 02:46:59.763355 17198 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 02:46:59.765718 17231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:46:59.766971 17198 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:46:59.767130 17198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "9fec36c1886747488310458b4216b779"
format_stamp: "Formatted at 2026-08-12 02:46:59 on dist-test-slave-2p8l"
server_key: "c5f54d7252806781bd79956413fed409"
server_key_iv: "555bcb80eb98f656c611782591388684"
server_key_version: "encryptionkey@0"
I20260812 02:46:59.767244 17198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:46:59.784878 17198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:46:59.788266 17198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:46:59.788475 17198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:46:59.796216 17198 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42575
I20260812 02:46:59.796245 17336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42575 every 8 connection(s)
I20260812 02:46:59.797224 17198 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:46:59.800141 17337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:46:59.804071 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 17198
I20260812 02:46:59.804230 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:46:59.804644 10541 external_mini_cluster.cc:1428] Setting key efdf675878aa4dab9753bf4e39d4fe23
I20260812 02:46:59.806550 17337 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779: Bootstrap starting.
I20260812 02:46:59.809088 17337 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779: Neither blocks nor log segments found. Creating new log.
I20260812 02:46:59.809907 17337 log.cc:824] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779: Log is configured to *not* fsync() on all Append() calls
I20260812 02:46:59.812232 17337 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779: No bootstrap required, opened a new log
I20260812 02:46:59.814566 17340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:59.806292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:47175 (local address 127.0.0.1:42575)
0812 02:46:59.806777 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:59.806795 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:59.806835 (+ 40us) server_negotiation.cc:407] Connection header received
0812 02:46:59.807559 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:59.807579 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:59.807948 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:59.808263 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:59.808623 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:59.809774 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:59.810889 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:59.811377 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:59.811510 (+ 133us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:59.812511 (+ 1001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:59.812518 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:59.812536 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:59.812921 (+ 385us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:59.812977 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:59.813010 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:59.813122 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:59.813336 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 02:46:59.813508 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":161,"threads_started":1}
I20260812 02:46:59.815506 17337 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fec36c1886747488310458b4216b779" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42575 } }
I20260812 02:46:59.815809 17337 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:46:59.815869 17337 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fec36c1886747488310458b4216b779, State: Initialized, Role: FOLLOWER
I20260812 02:46:59.816344 17337 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fec36c1886747488310458b4216b779" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42575 } }
I20260812 02:46:59.816532 17337 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:46:59.816629 17337 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:46:59.816741 17337 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:46:59.817903 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:46:59.817916 17337 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fec36c1886747488310458b4216b779" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42575 } }
I20260812 02:46:59.818286 17337 leader_election.cc:302] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9fec36c1886747488310458b4216b779; no voters:
I20260812 02:46:59.818645 17337 leader_election.cc:288] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:46:59.818792 17342 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:46:59.819051 17342 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779 [term 1 LEADER]: Becoming Leader. State: Replica: 9fec36c1886747488310458b4216b779, State: Running, Role: LEADER
I20260812 02:46:59.819406 17342 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fec36c1886747488310458b4216b779" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42575 } }
I20260812 02:46:59.819984 17337 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:46:59.821058 17345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9fec36c1886747488310458b4216b779" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fec36c1886747488310458b4216b779" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42575 } } }
I20260812 02:46:59.821184 17345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779 [sys.catalog]: This master's current role is: LEADER
I20260812 02:46:59.821556 17347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fec36c1886747488310458b4216b779. Latest consensus state: current_term: 1 leader_uuid: "9fec36c1886747488310458b4216b779" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fec36c1886747488310458b4216b779" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42575 } } }
I20260812 02:46:59.821681 17347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779 [sys.catalog]: This master's current role is: LEADER
W20260812 02:46:59.825498 17385 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:46:59.825577 17385 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:46:59.825677 17372 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:46:59.826467 17372 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:46:59.828910 17340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:46:59.820929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:51113 (local address 127.0.0.1:42575)
0812 02:46:59.821058 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 02:46:59.821062 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:46:59.822016 (+ 954us) server_negotiation.cc:407] Connection header received
0812 02:46:59.822833 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:46:59.822836 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:46:59.822905 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:46:59.822996 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:46:59.823294 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:59.823817 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:59.824715 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:46:59.824946 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:46:59.825052 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:46:59.828366 (+ 3314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:46:59.828370 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:46:59.828373 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:46:59.828388 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:46:59.828420 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:46:59.828435 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:46:59.828543 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 02:46:59.828728 (+ 185us) server_negotiation.cc:299] Negotiation successful
0812 02:46:59.828768 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 02:46:59.832074 17372 catalog_manager.cc:1347] Generated new cluster ID: 6007c8cbc33d4ef4ba49590b41847ee9
I20260812 02:46:59.832147 17372 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:46:59.872727 17372 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:46:59.874110 17372 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:46:59.891426 17372 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9fec36c1886747488310458b4216b779: Generated new TSK 0
I20260812 02:46:59.892194 17372 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:46:59.906663 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 17198
W20260812 02:46:59.920018 17160 connection.cc:535] client connection to 127.0.0.1:42575 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42575): Connection reset by peer (error 104)
2026-08-12T02:46:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1807 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:46:59 dist-test-slave-2p8l krb5kdc[17395](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:46:59 dist-test-slave-2p8l krb5kdc[17395](info): set up 2 sockets
Aug 12 02:46:59 dist-test-slave-2p8l krb5kdc[17395](info): commencing operation
krb5kdc: starting...
W20260812 02:47:01.247234 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.313s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:47:01 dist-test-slave-2p8l krb5kdc[17395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:47:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:47:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 02:47:01.371318 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36077
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36077
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:47:01.483189 17421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:47:01.483538 17421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:47:01.483582 17421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:47:01.487603 17421 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:47:01.487668 17421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:47:01.487686 17421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:47:01.487702 17421 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:47:01.487718 17421 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:47:01.492846 17421 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36077
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:47:01.493790 17421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:47:01.494763 17421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 02:47:01.503279 17421 server_base.cc:1034] running on GCE node
W20260812 02:47:01.503196 17433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:01.503197 17429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:01.503199 17430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:01.504001 17421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:47:01.505069 17421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:47:01.506260 17421 hybrid_clock.cc:648] HybridClock initialized: now 1786502821506240 us; error 33 us; skew 500 ppm
Aug 12 02:47:01 dist-test-slave-2p8l krb5kdc[17395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502821, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:47:01.509025 17421 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 02:47:01.509869 17421 webserver.cc:460] Webserver started at http://127.0.0.1:42481/ using document root <none> and password file <none>
I20260812 02:47:01.510484 17421 fs_manager.cc:359] Metadata directory not provided
I20260812 02:47:01.510581 17421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:47:01.510816 17421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:47:01.512806 17421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "e9b95d5ee00d48e59994490f72696b8f"
format_stamp: "Formatted at 2026-08-12 02:47:01 on dist-test-slave-2p8l"
server_key: "3f9eb7078f9c9ac41165e3392cf8c9d4"
server_key_iv: "4574167079e2b23e51a9a516e7a757d7"
server_key_version: "encryptionkey@0"
I20260812 02:47:01.513382 17421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "e9b95d5ee00d48e59994490f72696b8f"
format_stamp: "Formatted at 2026-08-12 02:47:01 on dist-test-slave-2p8l"
server_key: "3f9eb7078f9c9ac41165e3392cf8c9d4"
server_key_iv: "4574167079e2b23e51a9a516e7a757d7"
server_key_version: "encryptionkey@0"
I20260812 02:47:01.517230 17421 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 02:47:01.519665 17447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:47:01.520901 17421 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:47:01.521034 17421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "e9b95d5ee00d48e59994490f72696b8f"
format_stamp: "Formatted at 2026-08-12 02:47:01 on dist-test-slave-2p8l"
server_key: "3f9eb7078f9c9ac41165e3392cf8c9d4"
server_key_iv: "4574167079e2b23e51a9a516e7a757d7"
server_key_version: "encryptionkey@0"
I20260812 02:47:01.521134 17421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:47:01.525632 17421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:47:01.528501 17421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:47:01.528697 17421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:47:01.535815 17421 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36077
I20260812 02:47:01.535933 17539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36077 every 8 connection(s)
I20260812 02:47:01.536772 17421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:47:01.537581 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 17421
I20260812 02:47:01.537735 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:47:01.538097 10541 external_mini_cluster.cc:1428] Setting key 15b49d2da5b6b0ee3b4fc91306d2e3fe
I20260812 02:47:01.540045 17540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:47:01.543573 17547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:01.539427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:36283 (local address 127.0.0.1:36077)
0812 02:47:01.539837 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:01.539852 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:01.539887 (+ 35us) server_negotiation.cc:407] Connection header received
0812 02:47:01.540554 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:01.540572 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:01.540852 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:01.541119 (+ 267us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:01.542002 (+ 883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:01.542007 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:01.542018 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:47:01.542029 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:01.542401 (+ 372us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:47:01.542431 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:01.542550 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:01.542690 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 02:47:01.542868 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":133,"threads_started":1}
I20260812 02:47:01.546242 17540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f: Bootstrap starting.
I20260812 02:47:01.546294 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:47:01.548563 17540 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f: Neither blocks nor log segments found. Creating new log.
I20260812 02:47:01.549556 17540 log.cc:824] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f: Log is configured to *not* fsync() on all Append() calls
I20260812 02:47:01.550410 17547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:01.548318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:60461 (local address 127.0.0.1:36077)
0812 02:47:01.548469 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:01.548474 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:01.548732 (+ 258us) server_negotiation.cc:407] Connection header received
0812 02:47:01.548870 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:01.548872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:01.548903 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:01.548966 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:01.549832 (+ 866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:01.549871 (+ 39us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:01.549875 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:47:01.549894 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:01.549945 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:47:01.549963 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:01.550084 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:01.550269 (+ 185us) server_negotiation.cc:299] Negotiation successful
0812 02:47:01.550320 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 02:47:01.551819 17540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f: No bootstrap required, opened a new log
I20260812 02:47:01.555248 17540 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9b95d5ee00d48e59994490f72696b8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36077 } }
I20260812 02:47:01.555456 17540 raft_consensus.cc:374] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:47:01.555539 17540 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9b95d5ee00d48e59994490f72696b8f, State: Initialized, Role: FOLLOWER
I20260812 02:47:01.556008 17540 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9b95d5ee00d48e59994490f72696b8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36077 } }
I20260812 02:47:01.556154 17540 raft_consensus.cc:388] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:47:01.556222 17540 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:47:01.556340 17540 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:47:01.557386 17540 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9b95d5ee00d48e59994490f72696b8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36077 } }
I20260812 02:47:01.557756 17540 leader_election.cc:302] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e9b95d5ee00d48e59994490f72696b8f; no voters:
I20260812 02:47:01.558017 17540 leader_election.cc:288] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:47:01.558175 17554 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:47:01.558441 17554 raft_consensus.cc:686] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f [term 1 LEADER]: Becoming Leader. State: Replica: e9b95d5ee00d48e59994490f72696b8f, State: Running, Role: LEADER
I20260812 02:47:01.558789 17554 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9b95d5ee00d48e59994490f72696b8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36077 } }
I20260812 02:47:01.559247 17540 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:47:01.560541 17557 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e9b95d5ee00d48e59994490f72696b8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9b95d5ee00d48e59994490f72696b8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36077 } } }
I20260812 02:47:01.560541 17558 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9b95d5ee00d48e59994490f72696b8f. Latest consensus state: current_term: 1 leader_uuid: "e9b95d5ee00d48e59994490f72696b8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9b95d5ee00d48e59994490f72696b8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36077 } } }
I20260812 02:47:01.560703 17558 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:01.560703 17557 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f [sys.catalog]: This master's current role is: LEADER
W20260812 02:47:01.563874 17587 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:47:01.563958 17587 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:47:01.564046 17573 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:47:01.564738 17573 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:47:01.569631 17573 catalog_manager.cc:1347] Generated new cluster ID: c7fb5b45430c479c9fd56c04d246c39a
I20260812 02:47:01.569698 17573 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:47:01.578737 17573 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:47:01.579023 17573 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:47:01.584698 17573 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e9b95d5ee00d48e59994490f72696b8f: Generated new TSK 0
I20260812 02:47:01.585317 17573 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:47:01.595278 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 17421
2026-08-12T02:47:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1695 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:47:01 dist-test-slave-2p8l krb5kdc[17604](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:47:01 dist-test-slave-2p8l krb5kdc[17604](info): set up 2 sockets
Aug 12 02:47:01 dist-test-slave-2p8l krb5kdc[17604](info): commencing operation
krb5kdc: starting...
W20260812 02:47:02.911062 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:47:02 dist-test-slave-2p8l krb5kdc[17604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:47:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:47:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 02:47:03.042930 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34713
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34713
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:47:03.160511 17632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:47:03.160774 17632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:47:03.160818 17632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:47:03.164875 17632 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:47:03.164938 17632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:47:03.164958 17632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:47:03.164974 17632 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:47:03.165036 17632 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:47:03.170353 17632 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34713
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:47:03.171384 17632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:47:03.172398 17632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:47:03.180752 17643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:03.180795 17645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:03.180786 17648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:03.181145 17632 server_base.cc:1034] running on GCE node
I20260812 02:47:03.181692 17632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:47:03.182860 17632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:47:03.184031 17632 hybrid_clock.cc:648] HybridClock initialized: now 1786502823184004 us; error 39 us; skew 500 ppm
Aug 12 02:47:03 dist-test-slave-2p8l krb5kdc[17604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502823, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:47:03.191448 17632 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 02:47:03.192353 17632 webserver.cc:460] Webserver started at http://127.0.0.1:35527/ using document root <none> and password file <none>
I20260812 02:47:03.192934 17632 fs_manager.cc:359] Metadata directory not provided
I20260812 02:47:03.192998 17632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:47:03.193264 17632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:47:03.195403 17632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "e19441cb63a242598d1a7daa38ab5ded"
format_stamp: "Formatted at 2026-08-12 02:47:03 on dist-test-slave-2p8l"
server_key: "292e7fbd051fae585270b41e8051273c"
server_key_iv: "6174dda264f11f9d9264ebb3675a2118"
server_key_version: "encryptionkey@0"
I20260812 02:47:03.195986 17632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "e19441cb63a242598d1a7daa38ab5ded"
format_stamp: "Formatted at 2026-08-12 02:47:03 on dist-test-slave-2p8l"
server_key: "292e7fbd051fae585270b41e8051273c"
server_key_iv: "6174dda264f11f9d9264ebb3675a2118"
server_key_version: "encryptionkey@0"
I20260812 02:47:03.201296 17632 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 02:47:03.204571 17658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:47:03.206310 17632 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:47:03.206503 17632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "e19441cb63a242598d1a7daa38ab5ded"
format_stamp: "Formatted at 2026-08-12 02:47:03 on dist-test-slave-2p8l"
server_key: "292e7fbd051fae585270b41e8051273c"
server_key_iv: "6174dda264f11f9d9264ebb3675a2118"
server_key_version: "encryptionkey@0"
I20260812 02:47:03.206651 17632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:47:03.228456 17632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:47:03.233132 17632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:47:03.233428 17632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:47:03.242693 17632 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34713
I20260812 02:47:03.242744 17748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34713 every 8 connection(s)
I20260812 02:47:03.244028 17632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:47:03.247834 17749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:47:03.250735 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 17632
I20260812 02:47:03.250913 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:47:03.251283 10541 external_mini_cluster.cc:1428] Setting key 030455972f358472785a9e34aa7b0d16
I20260812 02:47:03.256958 17749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded: Bootstrap starting.
I20260812 02:47:03.260123 17749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded: Neither blocks nor log segments found. Creating new log.
I20260812 02:47:03.261093 17749 log.cc:824] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded: Log is configured to *not* fsync() on all Append() calls
Aug 12 02:47:03 dist-test-slave-2p8l krb5kdc[17604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 02:47:03.263764 17749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded: No bootstrap required, opened a new log
I20260812 02:47:03.268194 17749 raft_consensus.cc:348] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e19441cb63a242598d1a7daa38ab5ded" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34713 } }
I20260812 02:47:03.268497 17749 raft_consensus.cc:374] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:47:03.268584 17749 raft_consensus.cc:729] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19441cb63a242598d1a7daa38ab5ded, State: Initialized, Role: FOLLOWER
I20260812 02:47:03.268597 17754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:03.253242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:42199 (local address 127.0.0.1:34713)
0812 02:47:03.253869 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:03.253891 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:03.253963 (+ 72us) server_negotiation.cc:407] Connection header received
0812 02:47:03.254902 (+ 939us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:03.254931 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:03.255428 (+ 497us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:03.255869 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:03.256870 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:03.258048 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:03.259085 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:03.259644 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:03.259835 (+ 191us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:03.262982 (+ 3147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:03.262988 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:03.263008 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:03.263040 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:03.265062 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:03.265649 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:03.265655 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:03.265662 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:03.265785 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:03.266175 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:03.266184 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:03.266186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:03.266665 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:03.266932 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:03.267288 (+ 356us) server_negotiation.cc:299] Negotiation successful
0812 02:47:03.267581 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":184,"threads_started":1}
I20260812 02:47:03.269220 17749 consensus_queue.cc:260] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e19441cb63a242598d1a7daa38ab5ded" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34713 } }
I20260812 02:47:03.269418 17749 raft_consensus.cc:388] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:47:03.269531 17749 raft_consensus.cc:482] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:47:03.269640 17749 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:47:03.270998 17749 raft_consensus.cc:504] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e19441cb63a242598d1a7daa38ab5ded" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34713 } }
I20260812 02:47:03.271416 17749 leader_election.cc:302] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e19441cb63a242598d1a7daa38ab5ded; no voters:
I20260812 02:47:03.271857 17749 leader_election.cc:288] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:47:03.271977 17756 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:47:03.272205 17756 raft_consensus.cc:686] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded [term 1 LEADER]: Becoming Leader. State: Replica: e19441cb63a242598d1a7daa38ab5ded, State: Running, Role: LEADER
I20260812 02:47:03.272550 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:47:03.272653 17756 consensus_queue.cc:237] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e19441cb63a242598d1a7daa38ab5ded" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34713 } }
I20260812 02:47:03.273423 17749 sys_catalog.cc:564] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:47:03.274684 17759 sys_catalog.cc:455] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded [sys.catalog]: SysCatalogTable state changed. Reason: New leader e19441cb63a242598d1a7daa38ab5ded. Latest consensus state: current_term: 1 leader_uuid: "e19441cb63a242598d1a7daa38ab5ded" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e19441cb63a242598d1a7daa38ab5ded" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34713 } } }
I20260812 02:47:03.274811 17759 sys_catalog.cc:458] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:03.275173 17758 sys_catalog.cc:455] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e19441cb63a242598d1a7daa38ab5ded" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e19441cb63a242598d1a7daa38ab5ded" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34713 } } }
I20260812 02:47:03.275283 17758 sys_catalog.cc:458] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded [sys.catalog]: This master's current role is: LEADER
W20260812 02:47:03.279942 17798 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:47:03.280097 17798 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:47:03.280269 17789 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:47:03.281421 17789 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:47:03.286815 17754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:03.276839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:44227 (local address 127.0.0.1:34713)
0812 02:47:03.276995 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:03.277000 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:03.277242 (+ 242us) server_negotiation.cc:407] Connection header received
0812 02:47:03.277391 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:03.277394 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:03.277455 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:03.277549 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:03.278512 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:03.279355 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:03.280560 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:03.280825 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:03.280964 (+ 139us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:03.282773 (+ 1809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:03.282777 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:03.282780 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:03.282817 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:03.284451 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:03.285130 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:03.285134 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:03.285136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:03.285229 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:03.285634 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:03.285637 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:03.285639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:03.285884 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:03.286019 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:03.286510 (+ 491us) server_negotiation.cc:299] Negotiation successful
0812 02:47:03.286637 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 02:47:03.290244 17789 catalog_manager.cc:1347] Generated new cluster ID: e28e523e314b499d85314f3353ad491e
I20260812 02:47:03.290346 17789 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:47:03.311969 17789 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:47:03.313194 17789 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:47:03.323262 17789 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e19441cb63a242598d1a7daa38ab5ded: Generated new TSK 0
I20260812 02:47:03.324402 17789 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:47:03.339226 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 17632
W20260812 02:47:03.374682 17593 connection.cc:535] client connection to 127.0.0.1:34713 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34713): Connection reset by peer (error 104)
2026-08-12T02:47:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1759 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:47:03 dist-test-slave-2p8l krb5kdc[17816](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:47:03 dist-test-slave-2p8l krb5kdc[17816](info): set up 2 sockets
Aug 12 02:47:03 dist-test-slave-2p8l krb5kdc[17816](info): commencing operation
krb5kdc: starting...
W20260812 02:47:04.687902 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.297s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:47:04 dist-test-slave-2p8l krb5kdc[17816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:47:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:47:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 02:47:04.819197 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37151
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37151
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:47:04.934206 17855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:47:04.934456 17855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:47:04.934499 17855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:47:04.938498 17855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:47:04.938557 17855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:47:04.938577 17855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:47:04.938593 17855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:47:04.938608 17855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:47:04.943846 17855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37151
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:47:04.944875 17855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:47:04.945961 17855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:47:04.954396 17873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:04.954646 17855 server_base.cc:1034] running on GCE node
W20260812 02:47:04.954437 17863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:04.954456 17869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:04.955334 17855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:47:04.956391 17855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:47:04.957556 17855 hybrid_clock.cc:648] HybridClock initialized: now 1786502824957537 us; error 31 us; skew 500 ppm
Aug 12 02:47:04 dist-test-slave-2p8l krb5kdc[17816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502824, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:47:04.960353 17855 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 02:47:04.961164 17855 webserver.cc:460] Webserver started at http://127.0.0.1:45757/ using document root <none> and password file <none>
I20260812 02:47:04.961669 17855 fs_manager.cc:359] Metadata directory not provided
I20260812 02:47:04.961727 17855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:47:04.961894 17855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:47:04.963949 17855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "3934bd3762df48f4900e42075c454583"
format_stamp: "Formatted at 2026-08-12 02:47:04 on dist-test-slave-2p8l"
server_key: "176b7a9de251eb8f355f46362d56f263"
server_key_iv: "9a844ec3b95e307cd6129a3e29eef23c"
server_key_version: "encryptionkey@0"
I20260812 02:47:04.964468 17855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "3934bd3762df48f4900e42075c454583"
format_stamp: "Formatted at 2026-08-12 02:47:04 on dist-test-slave-2p8l"
server_key: "176b7a9de251eb8f355f46362d56f263"
server_key_iv: "9a844ec3b95e307cd6129a3e29eef23c"
server_key_version: "encryptionkey@0"
I20260812 02:47:04.968214 17855 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 02:47:04.970630 17884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:47:04.971892 17855 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:47:04.972030 17855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "3934bd3762df48f4900e42075c454583"
format_stamp: "Formatted at 2026-08-12 02:47:04 on dist-test-slave-2p8l"
server_key: "176b7a9de251eb8f355f46362d56f263"
server_key_iv: "9a844ec3b95e307cd6129a3e29eef23c"
server_key_version: "encryptionkey@0"
I20260812 02:47:04.972133 17855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:47:04.992259 17855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:47:04.995605 17855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:47:04.995817 17855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:47:05.003474 17855 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37151
I20260812 02:47:05.003538 17980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37151 every 8 connection(s)
I20260812 02:47:05.004809 17855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:47:05.005954 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 17855
I20260812 02:47:05.006112 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:47:05.006433 10541 external_mini_cluster.cc:1428] Setting key 3d4150b7c87bc1a51f756c1c077cd849
I20260812 02:47:05.008401 17981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:47:05.015522 17981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583: Bootstrap starting.
I20260812 02:47:05.016798 17988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:05.007923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:52165 (local address 127.0.0.1:37151)
0812 02:47:05.008372 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:05.008398 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:05.008443 (+ 45us) server_negotiation.cc:407] Connection header received
0812 02:47:05.009282 (+ 839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:05.009306 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:05.009761 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:05.010155 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:05.010576 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:05.012120 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:05.013014 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:05.013724 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:05.013887 (+ 163us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:05.014804 (+ 917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:05.014811 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:05.014827 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:47:05.015308 (+ 481us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:05.015375 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:47:05.015405 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:05.015551 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:05.015711 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 02:47:05.015846 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":130,"threads_started":1}
I20260812 02:47:05.018366 17981 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583: Neither blocks nor log segments found. Creating new log.
I20260812 02:47:05.019294 17981 log.cc:824] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583: Log is configured to *not* fsync() on all Append() calls
I20260812 02:47:05.019899 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:47:05.021741 17981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583: No bootstrap required, opened a new log
I20260812 02:47:05.026635 17981 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3934bd3762df48f4900e42075c454583" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37151 } }
I20260812 02:47:05.026921 17988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:05.022585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:52311 (local address 127.0.0.1:37151)
0812 02:47:05.022726 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:05.022730 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:05.022953 (+ 223us) server_negotiation.cc:407] Connection header received
0812 02:47:05.023076 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:05.023078 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:05.023123 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:05.023191 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:05.023484 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:05.023984 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:05.025150 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:05.025378 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:05.025461 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:05.026438 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:05.026441 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:05.026443 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:47:05.026455 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:05.026480 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:47:05.026490 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:05.026560 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:05.026716 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 02:47:05.026749 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 02:47:05.026964 17981 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:47:05.027041 17981 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3934bd3762df48f4900e42075c454583, State: Initialized, Role: FOLLOWER
I20260812 02:47:05.027547 17981 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3934bd3762df48f4900e42075c454583" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37151 } }
I20260812 02:47:05.027679 17981 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:47:05.027762 17981 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:47:05.027864 17981 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:47:05.028836 17981 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3934bd3762df48f4900e42075c454583" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37151 } }
I20260812 02:47:05.029155 17981 leader_election.cc:302] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3934bd3762df48f4900e42075c454583; no voters:
I20260812 02:47:05.029424 17981 leader_election.cc:288] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:47:05.029582 18000 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:47:05.029827 18000 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583 [term 1 LEADER]: Becoming Leader. State: Replica: 3934bd3762df48f4900e42075c454583, State: Running, Role: LEADER
I20260812 02:47:05.030205 18000 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3934bd3762df48f4900e42075c454583" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37151 } }
I20260812 02:47:05.030735 17981 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:47:05.031908 18003 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3934bd3762df48f4900e42075c454583" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3934bd3762df48f4900e42075c454583" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37151 } } }
I20260812 02:47:05.032049 18003 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583 [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:05.032407 18007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3934bd3762df48f4900e42075c454583. Latest consensus state: current_term: 1 leader_uuid: "3934bd3762df48f4900e42075c454583" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3934bd3762df48f4900e42075c454583" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37151 } } }
I20260812 02:47:05.032532 18026 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:47:05.032555 18007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583 [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:05.035842 18026 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:47:05.042232 18026 catalog_manager.cc:1347] Generated new cluster ID: d906b6b438db44659ecbfb1ba9922277
I20260812 02:47:05.042316 18026 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:47:05.061725 18026 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:47:05.062795 18026 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:47:05.072271 18026 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3934bd3762df48f4900e42075c454583: Generated new TSK 0
I20260812 02:47:05.072978 18026 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:47:05.085359 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 17855
W20260812 02:47:05.105860 17811 connection.cc:535] client connection to 127.0.0.1:37151 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37151): Connection reset by peer (error 104)
2026-08-12T02:47:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1730 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:47:05 dist-test-slave-2p8l krb5kdc[18043](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:47:05 dist-test-slave-2p8l krb5kdc[18043](info): set up 2 sockets
Aug 12 02:47:05 dist-test-slave-2p8l krb5kdc[18043](info): commencing operation
krb5kdc: starting...
W20260812 02:47:06.395778 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:47:06 dist-test-slave-2p8l krb5kdc[18043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:47:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:47:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 02:47:06.523054 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40187
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40187
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:47:06.637370 18071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:47:06.637609 18071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:47:06.637650 18071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:47:06.641589 18071 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:47:06.641644 18071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:47:06.641664 18071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:47:06.641680 18071 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:47:06.641695 18071 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:47:06.646708 18071 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40187
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40187
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:47:06.647639 18071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:47:06.648572 18071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:47:06.656840 18078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:06.656857 18088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:06.656823 18082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:06.657269 18071 server_base.cc:1034] running on GCE node
I20260812 02:47:06.657776 18071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:47:06.658968 18071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:47:06.660192 18071 hybrid_clock.cc:648] HybridClock initialized: now 1786502826660163 us; error 40 us; skew 500 ppm
Aug 12 02:47:06 dist-test-slave-2p8l krb5kdc[18043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502826, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:47:06.663021 18071 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 02:47:06.663985 18071 webserver.cc:460] Webserver started at http://127.0.0.1:36321/ using document root <none> and password file <none>
I20260812 02:47:06.664559 18071 fs_manager.cc:359] Metadata directory not provided
I20260812 02:47:06.664654 18071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:47:06.664881 18071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:47:06.666926 18071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "f80fbe92f9bc4794912a8310e5b117ed"
format_stamp: "Formatted at 2026-08-12 02:47:06 on dist-test-slave-2p8l"
server_key: "6ec60b522c53e522c696c1615f69884f"
server_key_iv: "fb0ab1669368cc5d9ae699f473b61424"
server_key_version: "encryptionkey@0"
I20260812 02:47:06.667514 18071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "f80fbe92f9bc4794912a8310e5b117ed"
format_stamp: "Formatted at 2026-08-12 02:47:06 on dist-test-slave-2p8l"
server_key: "6ec60b522c53e522c696c1615f69884f"
server_key_iv: "fb0ab1669368cc5d9ae699f473b61424"
server_key_version: "encryptionkey@0"
I20260812 02:47:06.671144 18071 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260812 02:47:06.673475 18102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:47:06.674713 18071 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 02:47:06.674858 18071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "f80fbe92f9bc4794912a8310e5b117ed"
format_stamp: "Formatted at 2026-08-12 02:47:06 on dist-test-slave-2p8l"
server_key: "6ec60b522c53e522c696c1615f69884f"
server_key_iv: "fb0ab1669368cc5d9ae699f473b61424"
server_key_version: "encryptionkey@0"
I20260812 02:47:06.674973 18071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:47:06.679572 18071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:47:06.682837 18071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:47:06.683056 18071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:47:06.690973 18071 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40187
I20260812 02:47:06.690981 18209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40187 every 8 connection(s)
I20260812 02:47:06.691952 18071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:47:06.694708 18212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:47:06.699872 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 18071
I20260812 02:47:06.700026 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:47:06.700232 18212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed: Bootstrap starting.
I20260812 02:47:06.700320 10541 external_mini_cluster.cc:1428] Setting key 44ec21780679cf08ecbceb4b7543a265
I20260812 02:47:06.702857 18212 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed: Neither blocks nor log segments found. Creating new log.
I20260812 02:47:06.703648 18212 log.cc:824] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed: Log is configured to *not* fsync() on all Append() calls
I20260812 02:47:06.706148 18216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:06.701653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:57993 (local address 127.0.0.1:40187)
0812 02:47:06.702154 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:06.702171 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:06.702210 (+ 39us) server_negotiation.cc:407] Connection header received
0812 02:47:06.703014 (+ 804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:06.703035 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:06.703354 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:06.703655 (+ 301us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:06.704777 (+ 1122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:06.704783 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:06.704795 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:47:06.704807 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:06.704865 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:47:06.704886 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:06.705048 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:06.705163 (+ 115us) server_negotiation.cc:299] Negotiation successful
0812 02:47:06.705352 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":155,"threads_started":1}
I20260812 02:47:06.706238 18212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed: No bootstrap required, opened a new log
I20260812 02:47:06.709362 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:47:06.710649 18212 raft_consensus.cc:348] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f80fbe92f9bc4794912a8310e5b117ed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40187 } }
I20260812 02:47:06.710902 18212 raft_consensus.cc:374] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:47:06.710990 18212 raft_consensus.cc:729] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f80fbe92f9bc4794912a8310e5b117ed, State: Initialized, Role: FOLLOWER
I20260812 02:47:06.711494 18212 consensus_queue.cc:260] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f80fbe92f9bc4794912a8310e5b117ed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40187 } }
I20260812 02:47:06.711679 18212 raft_consensus.cc:388] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:47:06.711817 18212 raft_consensus.cc:482] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:47:06.711925 18212 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:47:06.712904 18212 raft_consensus.cc:504] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f80fbe92f9bc4794912a8310e5b117ed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40187 } }
I20260812 02:47:06.713258 18212 leader_election.cc:302] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f80fbe92f9bc4794912a8310e5b117ed; no voters:
I20260812 02:47:06.713645 18212 leader_election.cc:288] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:47:06.713646 18216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:06.711695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:48699 (local address 127.0.0.1:40187)
0812 02:47:06.711801 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:06.711806 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:06.712084 (+ 278us) server_negotiation.cc:407] Connection header received
0812 02:47:06.712275 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:06.712279 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:06.712320 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:06.712409 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:06.713185 (+ 776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:06.713189 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:06.713191 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:47:06.713203 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:06.713239 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:47:06.713250 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:06.713344 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:06.713466 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 02:47:06.713514 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 02:47:06.713717 18228 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:47:06.713944 18228 raft_consensus.cc:686] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed [term 1 LEADER]: Becoming Leader. State: Replica: f80fbe92f9bc4794912a8310e5b117ed, State: Running, Role: LEADER
I20260812 02:47:06.714332 18228 consensus_queue.cc:237] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f80fbe92f9bc4794912a8310e5b117ed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40187 } }
I20260812 02:47:06.714956 18212 sys_catalog.cc:564] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:47:06.716221 18229 sys_catalog.cc:455] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader f80fbe92f9bc4794912a8310e5b117ed. Latest consensus state: current_term: 1 leader_uuid: "f80fbe92f9bc4794912a8310e5b117ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f80fbe92f9bc4794912a8310e5b117ed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40187 } } }
I20260812 02:47:06.716221 18230 sys_catalog.cc:455] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f80fbe92f9bc4794912a8310e5b117ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f80fbe92f9bc4794912a8310e5b117ed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40187 } } }
I20260812 02:47:06.716408 18229 sys_catalog.cc:458] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:06.716472 18230 sys_catalog.cc:458] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:06.716866 18248 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:47:06.720094 18248 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:47:06.725764 18248 catalog_manager.cc:1347] Generated new cluster ID: 0bff93bc235246ee801b0da83dc8917c
I20260812 02:47:06.725878 18248 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:47:06.732581 18248 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:47:06.732869 18248 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:47:06.748600 18248 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f80fbe92f9bc4794912a8310e5b117ed: Generated new TSK 0
I20260812 02:47:06.749388 18248 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:47:06.762210 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 18071
2026-08-12T02:47:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1667 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:47:06 dist-test-slave-2p8l krb5kdc[18266](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:47:06 dist-test-slave-2p8l krb5kdc[18266](info): set up 2 sockets
Aug 12 02:47:06 dist-test-slave-2p8l krb5kdc[18266](info): commencing operation
krb5kdc: starting...
W20260812 02:47:08.081454 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:47:08 dist-test-slave-2p8l krb5kdc[18266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502828, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:47:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:47:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:47:08.208395 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:44901
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:45011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:44901
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:47:08.325702 18292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:47:08.325991 18292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:47:08.326120 18292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:47:08.330101 18292 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:47:08.330192 18292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:47:08.330229 18292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:47:08.330287 18292 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:47:08.330324 18292 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:47:08.335698 18292 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:45011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:44901
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:44901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:47:08.336790 18292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:47:08.337829 18292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:47:08.347010 18306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:08.347010 18297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:08.347054 18301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:08.347363 18292 server_base.cc:1034] running on GCE node
I20260812 02:47:08.347915 18292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:47:08.348992 18292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:47:08.350149 18292 hybrid_clock.cc:648] HybridClock initialized: now 1786502828350136 us; error 37 us; skew 500 ppm
Aug 12 02:47:08 dist-test-slave-2p8l krb5kdc[18266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502828, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:47:08.358268 18292 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:47:08.359277 18292 webserver.cc:460] Webserver started at http://127.10.75.126:35909/ using document root <none> and password file <none>
I20260812 02:47:08.359855 18292 fs_manager.cc:359] Metadata directory not provided
I20260812 02:47:08.359949 18292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:47:08.360203 18292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:47:08.362335 18292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "d875763090d5405991a20b88568aefac"
format_stamp: "Formatted at 2026-08-12 02:47:08 on dist-test-slave-2p8l"
server_key: "e90e1b0d2c36ce4af7d01633ee720511"
server_key_iv: "90dc0d736e3eac192f975b0a3ded302a"
server_key_version: "encryptionkey@0"
I20260812 02:47:08.362900 18292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "d875763090d5405991a20b88568aefac"
format_stamp: "Formatted at 2026-08-12 02:47:08 on dist-test-slave-2p8l"
server_key: "e90e1b0d2c36ce4af7d01633ee720511"
server_key_iv: "90dc0d736e3eac192f975b0a3ded302a"
server_key_version: "encryptionkey@0"
I20260812 02:47:08.366672 18292 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:47:08.369027 18316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:47:08.370312 18292 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:47:08.370455 18292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "d875763090d5405991a20b88568aefac"
format_stamp: "Formatted at 2026-08-12 02:47:08 on dist-test-slave-2p8l"
server_key: "e90e1b0d2c36ce4af7d01633ee720511"
server_key_iv: "90dc0d736e3eac192f975b0a3ded302a"
server_key_version: "encryptionkey@0"
I20260812 02:47:08.370563 18292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:47:08.390255 18292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:47:08.393349 18292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:47:08.393559 18292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:47:08.401027 18292 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:44901
I20260812 02:47:08.401046 18422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:44901 every 8 connection(s)
I20260812 02:47:08.401968 18292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:47:08.404659 18426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:47:08.405203 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 18292
I20260812 02:47:08.405347 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:47:08.405663 10541 external_mini_cluster.cc:1428] Setting key c3243127061ce460ddfa3c19c4582f3b
I20260812 02:47:08.410635 18426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac: Bootstrap starting.
I20260812 02:47:08.412889 18426 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac: Neither blocks nor log segments found. Creating new log.
I20260812 02:47:08.413645 18426 log.cc:824] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac: Log is configured to *not* fsync() on all Append() calls
Aug 12 02:47:08 dist-test-slave-2p8l krb5kdc[18266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502828, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:47:08.415637 18426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac: No bootstrap required, opened a new log
I20260812 02:47:08.419272 18426 raft_consensus.cc:348] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d875763090d5405991a20b88568aefac" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44901 } }
I20260812 02:47:08.419481 18426 raft_consensus.cc:374] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:47:08.419564 18426 raft_consensus.cc:729] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d875763090d5405991a20b88568aefac, State: Initialized, Role: FOLLOWER
I20260812 02:47:08.419993 18426 consensus_queue.cc:260] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d875763090d5405991a20b88568aefac" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44901 } }
I20260812 02:47:08.420117 18426 raft_consensus.cc:388] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:47:08.420204 18431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:08.407120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42693 (local address 127.10.75.126:44901)
0812 02:47:08.407557 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:08.407574 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:08.407618 (+ 44us) server_negotiation.cc:407] Connection header received
0812 02:47:08.408277 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:08.408294 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:08.408614 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:08.408939 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:08.409738 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:08.410792 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:08.411696 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:08.412165 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:08.412337 (+ 172us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:08.415168 (+ 2831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:08.415173 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:08.415186 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:08.415214 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:08.416916 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:08.417433 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:08.417444 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:08.417449 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:08.417556 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:08.417913 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:08.417921 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:08.417923 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:08.418371 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:08.418617 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:08.419038 (+ 421us) server_negotiation.cc:299] Negotiation successful
0812 02:47:08.419253 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":132,"threads_started":1}
I20260812 02:47:08.420210 18426 raft_consensus.cc:482] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:47:08.420387 18426 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:47:08.421326 18426 raft_consensus.cc:504] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d875763090d5405991a20b88568aefac" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44901 } }
I20260812 02:47:08.421661 18426 leader_election.cc:302] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d875763090d5405991a20b88568aefac; no voters:
I20260812 02:47:08.421965 18426 leader_election.cc:288] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:47:08.422093 18434 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:47:08.422372 18434 raft_consensus.cc:686] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac [term 1 LEADER]: Becoming Leader. State: Replica: d875763090d5405991a20b88568aefac, State: Running, Role: LEADER
I20260812 02:47:08.422665 18434 consensus_queue.cc:237] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d875763090d5405991a20b88568aefac" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44901 } }
I20260812 02:47:08.423156 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:47:08.423360 18426 sys_catalog.cc:564] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:47:08.423828 18434 sys_catalog.cc:455] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d875763090d5405991a20b88568aefac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d875763090d5405991a20b88568aefac" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44901 } } }
I20260812 02:47:08.423954 18434 sys_catalog.cc:458] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:08.424263 18436 sys_catalog.cc:455] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac [sys.catalog]: SysCatalogTable state changed. Reason: New leader d875763090d5405991a20b88568aefac. Latest consensus state: current_term: 1 leader_uuid: "d875763090d5405991a20b88568aefac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d875763090d5405991a20b88568aefac" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44901 } } }
I20260812 02:47:08.424374 18436 sys_catalog.cc:458] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac [sys.catalog]: This master's current role is: LEADER
W20260812 02:47:08.428403 18469 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:47:08.428490 18469 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:47:08.428610 18442 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:47:08.429611 18442 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:47:08.434221 18431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:08.425793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36901 (local address 127.10.75.126:44901)
0812 02:47:08.425904 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:08.425908 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:08.426112 (+ 204us) server_negotiation.cc:407] Connection header received
0812 02:47:08.426258 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:08.426261 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:08.426308 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:08.426392 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:08.427238 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:08.427996 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:08.429017 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:08.429259 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:08.429371 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:08.430842 (+ 1471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:08.430846 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:08.430850 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:08.430879 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:08.432355 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:08.432898 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:08.432904 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:08.432910 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:08.432981 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:08.433317 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:08.433320 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:08.433322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:08.433493 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:08.433651 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:08.433925 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 02:47:08.434020 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 02:47:08.435631 18442 catalog_manager.cc:1347] Generated new cluster ID: c482e128081f4eaab3f2387f863e812d
I20260812 02:47:08.435696 18442 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:47:08.448947 18442 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:47:08.449924 18442 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:47:08.456187 18442 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d875763090d5405991a20b88568aefac: Generated new TSK 0
I20260812 02:47:08.456820 18442 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:47:08.461772 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 18292
W20260812 02:47:08.475111 18263 connection.cc:535] client connection to 127.10.75.126:44901 recv error: Network error: failed to read from TLS socket (remote: 127.10.75.126:44901): Connection reset by peer (error 104)
2026-08-12T02:47:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1701 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:47:08 dist-test-slave-2p8l krb5kdc[18481](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:47:08 dist-test-slave-2p8l krb5kdc[18481](info): set up 2 sockets
Aug 12 02:47:08 dist-test-slave-2p8l krb5kdc[18481](info): commencing operation
krb5kdc: starting...
W20260812 02:47:09.768772 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:47:09 dist-test-slave-2p8l krb5kdc[18481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:47:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:47:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:47:09.895500 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:37191
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:33057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:37191
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:47:10.008013 18502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:47:10.008314 18502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:47:10.008391 18502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:47:10.012374 18502 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:47:10.012465 18502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:47:10.012517 18502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:47:10.012586 18502 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:47:10.012627 18502 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:47:10.017851 18502 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:33057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:37191
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:37191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:47:10.018891 18502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:47:10.019907 18502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:47:10.029472 18510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:10.029462 18519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:10.029462 18513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:10.029670 18502 server_base.cc:1034] running on GCE node
I20260812 02:47:10.030462 18502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:47:10.031649 18502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:47:10.032872 18502 hybrid_clock.cc:648] HybridClock initialized: now 1786502830032849 us; error 48 us; skew 500 ppm
Aug 12 02:47:10 dist-test-slave-2p8l krb5kdc[18481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502830, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:47:10.035996 18502 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:47:10.036948 18502 webserver.cc:460] Webserver started at http://127.10.75.126:34355/ using document root <none> and password file <none>
I20260812 02:47:10.037492 18502 fs_manager.cc:359] Metadata directory not provided
I20260812 02:47:10.037559 18502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:47:10.037731 18502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:47:10.039914 18502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "4c14d9ad888d4f6dbdbdd7f2d622d686"
format_stamp: "Formatted at 2026-08-12 02:47:10 on dist-test-slave-2p8l"
server_key: "62eceebd241e34f15aa92f27441c4263"
server_key_iv: "e2af2ee33bfbb840db9f4408dc43fcfc"
server_key_version: "encryptionkey@0"
I20260812 02:47:10.040463 18502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "4c14d9ad888d4f6dbdbdd7f2d622d686"
format_stamp: "Formatted at 2026-08-12 02:47:10 on dist-test-slave-2p8l"
server_key: "62eceebd241e34f15aa92f27441c4263"
server_key_iv: "e2af2ee33bfbb840db9f4408dc43fcfc"
server_key_version: "encryptionkey@0"
I20260812 02:47:10.044461 18502 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260812 02:47:10.047252 18532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:47:10.048514 18502 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 02:47:10.048621 18502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "4c14d9ad888d4f6dbdbdd7f2d622d686"
format_stamp: "Formatted at 2026-08-12 02:47:10 on dist-test-slave-2p8l"
server_key: "62eceebd241e34f15aa92f27441c4263"
server_key_iv: "e2af2ee33bfbb840db9f4408dc43fcfc"
server_key_version: "encryptionkey@0"
I20260812 02:47:10.048712 18502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:47:10.064262 18502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:47:10.067471 18502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:47:10.067620 18502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:47:10.075374 18502 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:37191
I20260812 02:47:10.075399 18628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:37191 every 8 connection(s)
I20260812 02:47:10.076334 18502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:47:10.079126 18630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:47:10.082301 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 18502
I20260812 02:47:10.082463 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:47:10.082772 10541 external_mini_cluster.cc:1428] Setting key 48c6c4970e341edb7083050d6e366849
I20260812 02:47:10.085120 18630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686: Bootstrap starting.
I20260812 02:47:10.087337 18630 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686: Neither blocks nor log segments found. Creating new log.
I20260812 02:47:10.088091 18630 log.cc:824] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686: Log is configured to *not* fsync() on all Append() calls
I20260812 02:47:10.089895 18630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686: No bootstrap required, opened a new log
I20260812 02:47:10.091908 18640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:10.084163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48511 (local address 127.10.75.126:37191)
0812 02:47:10.084664 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:10.084680 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:10.084715 (+ 35us) server_negotiation.cc:407] Connection header received
0812 02:47:10.085409 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:10.085429 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:10.085759 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:10.086102 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:10.086508 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:10.087509 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:10.088451 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:10.088977 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:10.089152 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:10.090122 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:10.090128 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:10.090151 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:47:10.090516 (+ 365us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:10.090577 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:47:10.090600 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:10.090742 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:10.090896 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 02:47:10.091035 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":128,"threads_started":1}
I20260812 02:47:10.092995 18630 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c14d9ad888d4f6dbdbdd7f2d622d686" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37191 } }
I20260812 02:47:10.093238 18630 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:47:10.093319 18630 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c14d9ad888d4f6dbdbdd7f2d622d686, State: Initialized, Role: FOLLOWER
I20260812 02:47:10.093789 18630 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c14d9ad888d4f6dbdbdd7f2d622d686" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37191 } }
I20260812 02:47:10.093964 18630 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:47:10.094050 18630 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:47:10.094213 18630 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:47:10.094867 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:47:10.095286 18630 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c14d9ad888d4f6dbdbdd7f2d622d686" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37191 } }
I20260812 02:47:10.095619 18630 leader_election.cc:302] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c14d9ad888d4f6dbdbdd7f2d622d686; no voters:
I20260812 02:47:10.095943 18630 leader_election.cc:288] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:47:10.096020 18648 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:47:10.096293 18648 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686 [term 1 LEADER]: Becoming Leader. State: Replica: 4c14d9ad888d4f6dbdbdd7f2d622d686, State: Running, Role: LEADER
I20260812 02:47:10.096663 18648 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c14d9ad888d4f6dbdbdd7f2d622d686" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37191 } }
I20260812 02:47:10.097247 18630 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:47:10.097925 18648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c14d9ad888d4f6dbdbdd7f2d622d686. Latest consensus state: current_term: 1 leader_uuid: "4c14d9ad888d4f6dbdbdd7f2d622d686" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c14d9ad888d4f6dbdbdd7f2d622d686" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37191 } } }
I20260812 02:47:10.098747 18648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686 [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:10.098628 18653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c14d9ad888d4f6dbdbdd7f2d622d686" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c14d9ad888d4f6dbdbdd7f2d622d686" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 37191 } } }
I20260812 02:47:10.099074 18653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686 [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:10.101994 18640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:10.097140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44819 (local address 127.10.75.126:37191)
0812 02:47:10.097259 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:10.097264 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:10.097575 (+ 311us) server_negotiation.cc:407] Connection header received
0812 02:47:10.097707 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:10.097710 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:10.097756 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:10.097813 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:10.098296 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:10.099055 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:10.100143 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:10.100469 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:10.100603 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:10.101452 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:10.101456 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:10.101458 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:47:10.101473 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:10.101512 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:47:10.101533 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:10.101649 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:10.101820 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 02:47:10.101855 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260812 02:47:10.103186 18678 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:47:10.103281 18678 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:47:10.103338 18668 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:47:10.104192 18668 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:47:10.110116 18668 catalog_manager.cc:1347] Generated new cluster ID: 7344a9d686584bfca868851d364ef283
I20260812 02:47:10.110198 18668 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:47:10.124541 18668 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:47:10.125720 18668 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:47:10.134464 18668 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c14d9ad888d4f6dbdbdd7f2d622d686: Generated new TSK 0
I20260812 02:47:10.135227 18668 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:47:10.141348 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 18502
W20260812 02:47:10.155143 18479 connection.cc:535] client connection to 127.10.75.126:37191 recv error: Network error: failed to read from TLS socket (remote: 127.10.75.126:37191): Connection reset by peer (error 104)
2026-08-12T02:47:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1680 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:47:10 dist-test-slave-2p8l krb5kdc[18687](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:47:10 dist-test-slave-2p8l krb5kdc[18687](info): set up 2 sockets
Aug 12 02:47:10 dist-test-slave-2p8l krb5kdc[18687](info): commencing operation
krb5kdc: starting...
W20260812 02:47:11.500530 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.331s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:47:11 dist-test-slave-2p8l krb5kdc[18687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:47:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:47:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:47:11.625627 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:42423
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:34355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:42423
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:47:11.737121 18706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:47:11.737418 18706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:47:11.737500 18706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:47:11.741552 18706 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:47:11.741751 18706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:47:11.741858 18706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:47:11.741919 18706 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:47:11.741983 18706 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:47:11.747912 18706 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:34355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:42423
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:42423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18706
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:47:11.749015 18706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:47:11.750116 18706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:47:11.759385 18713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:11.759531 18706 server_base.cc:1034] running on GCE node
W20260812 02:47:11.759441 18717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:11.759744 18719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:11.760332 18706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:47:11.761355 18706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:47:11.762526 18706 hybrid_clock.cc:648] HybridClock initialized: now 1786502831762507 us; error 32 us; skew 500 ppm
Aug 12 02:47:11 dist-test-slave-2p8l krb5kdc[18687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502831, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:47:11.765405 18706 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:47:11.766395 18706 webserver.cc:460] Webserver started at http://127.10.75.126:39243/ using document root <none> and password file <none>
I20260812 02:47:11.766942 18706 fs_manager.cc:359] Metadata directory not provided
I20260812 02:47:11.767035 18706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:47:11.767292 18706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:47:11.769304 18706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "0b5fc804bdc94ef1b03f2fd41b614bd1"
format_stamp: "Formatted at 2026-08-12 02:47:11 on dist-test-slave-2p8l"
server_key: "e6e4e34ffd3ba7739af0e261521c9f12"
server_key_iv: "43b90568f4a44be8b97ed4ac6659d651"
server_key_version: "encryptionkey@0"
I20260812 02:47:11.769874 18706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "0b5fc804bdc94ef1b03f2fd41b614bd1"
format_stamp: "Formatted at 2026-08-12 02:47:11 on dist-test-slave-2p8l"
server_key: "e6e4e34ffd3ba7739af0e261521c9f12"
server_key_iv: "43b90568f4a44be8b97ed4ac6659d651"
server_key_version: "encryptionkey@0"
I20260812 02:47:11.773597 18706 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 02:47:11.776373 18739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:47:11.777612 18706 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:47:11.777776 18706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "0b5fc804bdc94ef1b03f2fd41b614bd1"
format_stamp: "Formatted at 2026-08-12 02:47:11 on dist-test-slave-2p8l"
server_key: "e6e4e34ffd3ba7739af0e261521c9f12"
server_key_iv: "43b90568f4a44be8b97ed4ac6659d651"
server_key_version: "encryptionkey@0"
I20260812 02:47:11.777894 18706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:47:11.782537 18706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:47:11.785811 18706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:47:11.786015 18706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:47:11.793388 18706 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:42423
I20260812 02:47:11.793443 18863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:42423 every 8 connection(s)
I20260812 02:47:11.794395 18706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:47:11.797200 18865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:47:11.801985 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 18706
I20260812 02:47:11.802165 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:47:11.802451 10541 external_mini_cluster.cc:1428] Setting key cccec965d7118d59b0dac84b7836b538
I20260812 02:47:11.803036 18865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1: Bootstrap starting.
I20260812 02:47:11.805462 18865 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1: Neither blocks nor log segments found. Creating new log.
I20260812 02:47:11.806447 18865 log.cc:824] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1: Log is configured to *not* fsync() on all Append() calls
I20260812 02:47:11.807668 18870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:11.803771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35803 (local address 127.10.75.126:42423)
0812 02:47:11.804178 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:11.804194 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:11.804230 (+ 36us) server_negotiation.cc:407] Connection header received
0812 02:47:11.804899 (+ 669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:11.804918 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:11.805200 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:11.805480 (+ 280us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:11.806385 (+ 905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:11.806390 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:11.806402 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:47:11.806412 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:11.806465 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:47:11.806483 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:11.806656 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:11.806738 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 02:47:11.806903 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":130,"threads_started":1}
I20260812 02:47:11.808460 18865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1: No bootstrap required, opened a new log
I20260812 02:47:11.810563 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:47:11.812909 18865 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b5fc804bdc94ef1b03f2fd41b614bd1" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42423 } }
I20260812 02:47:11.813205 18865 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:47:11.813278 18865 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5fc804bdc94ef1b03f2fd41b614bd1, State: Initialized, Role: FOLLOWER
I20260812 02:47:11.813771 18865 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b5fc804bdc94ef1b03f2fd41b614bd1" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42423 } }
I20260812 02:47:11.813931 18865 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:47:11.814023 18865 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:47:11.814153 18865 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:47:11.814815 18870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:11.812922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37503 (local address 127.10.75.126:42423)
0812 02:47:11.813061 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:11.813065 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:11.813306 (+ 241us) server_negotiation.cc:407] Connection header received
0812 02:47:11.813477 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:11.813480 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:11.813512 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:11.813577 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:11.814365 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:11.814368 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:11.814369 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:47:11.814380 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:11.814404 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:47:11.814414 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:11.814485 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:11.814602 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 02:47:11.814658 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 02:47:11.815342 18865 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b5fc804bdc94ef1b03f2fd41b614bd1" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42423 } }
I20260812 02:47:11.815696 18865 leader_election.cc:302] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b5fc804bdc94ef1b03f2fd41b614bd1; no voters:
I20260812 02:47:11.816010 18865 leader_election.cc:288] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:47:11.816147 18887 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:47:11.816432 18887 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5fc804bdc94ef1b03f2fd41b614bd1, State: Running, Role: LEADER
I20260812 02:47:11.816737 18887 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b5fc804bdc94ef1b03f2fd41b614bd1" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42423 } }
I20260812 02:47:11.817360 18865 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:47:11.818624 18889 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b5fc804bdc94ef1b03f2fd41b614bd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b5fc804bdc94ef1b03f2fd41b614bd1" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42423 } } }
I20260812 02:47:11.818648 18890 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b5fc804bdc94ef1b03f2fd41b614bd1. Latest consensus state: current_term: 1 leader_uuid: "0b5fc804bdc94ef1b03f2fd41b614bd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b5fc804bdc94ef1b03f2fd41b614bd1" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 42423 } } }
I20260812 02:47:11.818849 18890 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1 [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:11.818884 18889 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1 [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:11.819427 18906 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:47:11.822434 18906 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:47:11.827592 18906 catalog_manager.cc:1347] Generated new cluster ID: 7c91ab1df30d41689acbd1702da3ffed
I20260812 02:47:11.827670 18906 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:47:11.834636 18906 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:47:11.834957 18906 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:47:11.849107 18906 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0b5fc804bdc94ef1b03f2fd41b614bd1: Generated new TSK 0
I20260812 02:47:11.849907 18906 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:47:11.858942 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 18706
2026-08-12T02:47:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1720 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:47:11 dist-test-slave-2p8l krb5kdc[18925](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:47:11 dist-test-slave-2p8l krb5kdc[18925](info): set up 2 sockets
Aug 12 02:47:11 dist-test-slave-2p8l krb5kdc[18925](info): commencing operation
krb5kdc: starting...
W20260812 02:47:13.263406 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.373s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:47:13 dist-test-slave-2p8l krb5kdc[18925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:47:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:47:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:47:13.389290 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:43293
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:46489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:43293
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:47:13.499701 18943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:47:13.500006 18943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:47:13.500083 18943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:47:13.504135 18943 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:47:13.504228 18943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:47:13.504279 18943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:47:13.504338 18943 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:47:13.504377 18943 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:47:13.509557 18943 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:46489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:43293
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:43293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:47:13.510627 18943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:47:13.511637 18943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:47:13.520689 18957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:13.520682 18955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:13.520748 18943 server_base.cc:1034] running on GCE node
W20260812 02:47:13.520677 18954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:13.521562 18943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:47:13.522699 18943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:47:13.523871 18943 hybrid_clock.cc:648] HybridClock initialized: now 1786502833523844 us; error 40 us; skew 500 ppm
Aug 12 02:47:13 dist-test-slave-2p8l krb5kdc[18925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502833, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:47:13.531488 18943 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:47:13.532419 18943 webserver.cc:460] Webserver started at http://127.10.75.126:42457/ using document root <none> and password file <none>
I20260812 02:47:13.532980 18943 fs_manager.cc:359] Metadata directory not provided
I20260812 02:47:13.533098 18943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:47:13.533334 18943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:47:13.535485 18943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "c2b80e4374354a5b8ebb7e118856856d"
format_stamp: "Formatted at 2026-08-12 02:47:13 on dist-test-slave-2p8l"
server_key: "516bb9adc423f3bd7a8aae590ddb5de4"
server_key_iv: "77f612c445e8a360af4b1caf8be80600"
server_key_version: "encryptionkey@0"
I20260812 02:47:13.536077 18943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "c2b80e4374354a5b8ebb7e118856856d"
format_stamp: "Formatted at 2026-08-12 02:47:13 on dist-test-slave-2p8l"
server_key: "516bb9adc423f3bd7a8aae590ddb5de4"
server_key_iv: "77f612c445e8a360af4b1caf8be80600"
server_key_version: "encryptionkey@0"
I20260812 02:47:13.539788 18943 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 02:47:13.542244 18971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:47:13.543490 18943 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:47:13.543634 18943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "c2b80e4374354a5b8ebb7e118856856d"
format_stamp: "Formatted at 2026-08-12 02:47:13 on dist-test-slave-2p8l"
server_key: "516bb9adc423f3bd7a8aae590ddb5de4"
server_key_iv: "77f612c445e8a360af4b1caf8be80600"
server_key_version: "encryptionkey@0"
I20260812 02:47:13.543742 18943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:47:13.577324 18943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:47:13.580226 18943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:47:13.580427 18943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:47:13.587821 18943 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:43293
I20260812 02:47:13.587846 19060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:43293 every 8 connection(s)
I20260812 02:47:13.588742 18943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:47:13.591506 19062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:47:13.596045 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 18943
I20260812 02:47:13.596217 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:47:13.596517 10541 external_mini_cluster.cc:1428] Setting key 7b419387ee09d99750a0847327f177ce
I20260812 02:47:13.597206 19062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d: Bootstrap starting.
I20260812 02:47:13.599699 19062 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d: Neither blocks nor log segments found. Creating new log.
I20260812 02:47:13.600663 19062 log.cc:824] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d: Log is configured to *not* fsync() on all Append() calls
I20260812 02:47:13.602929 19062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d: No bootstrap required, opened a new log
Aug 12 02:47:13 dist-test-slave-2p8l krb5kdc[18925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:47:13.607267 19062 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2b80e4374354a5b8ebb7e118856856d" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43293 } }
I20260812 02:47:13.607511 19062 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:47:13.607601 19062 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2b80e4374354a5b8ebb7e118856856d, State: Initialized, Role: FOLLOWER
I20260812 02:47:13.608024 19062 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2b80e4374354a5b8ebb7e118856856d" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43293 } }
I20260812 02:47:13.608171 19062 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:47:13.608258 19062 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:47:13.608374 19062 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:47:13.609236 19062 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2b80e4374354a5b8ebb7e118856856d" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43293 } }
I20260812 02:47:13.609580 19062 leader_election.cc:302] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2b80e4374354a5b8ebb7e118856856d; no voters:
I20260812 02:47:13.609917 19062 leader_election.cc:288] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:47:13.609987 19072 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:47:13.610222 19072 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d [term 1 LEADER]: Becoming Leader. State: Replica: c2b80e4374354a5b8ebb7e118856856d, State: Running, Role: LEADER
I20260812 02:47:13.610567 19072 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2b80e4374354a5b8ebb7e118856856d" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43293 } }
I20260812 02:47:13.611231 19062 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:47:13.611754 19068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:13.597838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45867 (local address 127.10.75.126:43293)
0812 02:47:13.598257 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:13.598289 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:13.598325 (+ 36us) server_negotiation.cc:407] Connection header received
0812 02:47:13.598944 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:13.598960 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:13.599285 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:13.599608 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:13.600563 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:13.601614 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:13.602771 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:13.603288 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:13.603408 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:13.606308 (+ 2900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:13.606313 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:13.606326 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:13.606353 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:13.608357 (+ 2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:13.608781 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:13.608787 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:13.608793 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:13.608916 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:13.609219 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:13.609223 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:13.609225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:13.609726 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:13.609952 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:13.610630 (+ 678us) server_negotiation.cc:299] Negotiation successful
0812 02:47:13.610910 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":180,"threads_started":1}
I20260812 02:47:13.612325 19073 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2b80e4374354a5b8ebb7e118856856d. Latest consensus state: current_term: 1 leader_uuid: "c2b80e4374354a5b8ebb7e118856856d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2b80e4374354a5b8ebb7e118856856d" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43293 } } }
I20260812 02:47:13.612354 19074 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2b80e4374354a5b8ebb7e118856856d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2b80e4374354a5b8ebb7e118856856d" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 43293 } } }
I20260812 02:47:13.612455 19074 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:13.612457 19073 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:13.613224 19088 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:47:13.614727 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:47:13.616499 19088 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:47:13.622395 19088 catalog_manager.cc:1347] Generated new cluster ID: 490baf7df0c74372a5b826ad3cb6cf3d
I20260812 02:47:13.622463 19088 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:47:13.626283 19068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:13.616782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52373 (local address 127.10.75.126:43293)
0812 02:47:13.616898 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:13.616903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:13.617301 (+ 398us) server_negotiation.cc:407] Connection header received
0812 02:47:13.617420 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:13.617423 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:13.617463 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:13.617554 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:13.618199 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:13.618855 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:13.620018 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:13.620904 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:13.621032 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:13.622658 (+ 1626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:13.622662 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:13.622664 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:13.622689 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:13.624363 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:13.624833 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:13.624836 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:13.624838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:13.624913 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:13.625168 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:13.625171 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:13.625173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:13.625353 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:13.625452 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:13.625992 (+ 540us) server_negotiation.cc:299] Negotiation successful
0812 02:47:13.626134 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 02:47:13.634838 19088 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:47:13.635710 19088 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:47:13.643198 19088 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2b80e4374354a5b8ebb7e118856856d: Generated new TSK 0
I20260812 02:47:13.643831 19088 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:47:13.649638 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 18943
2026-08-12T02:47:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1789 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:47:13 dist-test-slave-2p8l krb5kdc[19111](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:47:13 dist-test-slave-2p8l krb5kdc[19111](info): set up 2 sockets
Aug 12 02:47:13 dist-test-slave-2p8l krb5kdc[19111](info): commencing operation
krb5kdc: starting...
W20260812 02:47:14.996218 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.316s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:47:15 dist-test-slave-2p8l krb5kdc[19111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:47:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:47:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:47:15.133670 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:44957
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:45951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:44957
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:47:15.245370 19132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:47:15.245689 19132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:47:15.245767 19132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:47:15.249752 19132 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:47:15.249850 19132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:47:15.249889 19132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:47:15.249951 19132 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:47:15.249993 19132 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:47:15.255180 19132 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:45951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:44957
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:44957
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:47:15.256207 19132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:47:15.257201 19132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:47:15.265607 19139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:15.265604 19140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:15.265789 19132 server_base.cc:1034] running on GCE node
W20260812 02:47:15.265673 19145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:15.266459 19132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:47:15.267508 19132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:47:15.268679 19132 hybrid_clock.cc:648] HybridClock initialized: now 1786502835268662 us; error 33 us; skew 500 ppm
Aug 12 02:47:15 dist-test-slave-2p8l krb5kdc[19111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502835, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:47:15.271620 19132 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:47:15.272496 19132 webserver.cc:460] Webserver started at http://127.10.75.126:42069/ using document root <none> and password file <none>
I20260812 02:47:15.273037 19132 fs_manager.cc:359] Metadata directory not provided
I20260812 02:47:15.273113 19132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:47:15.273339 19132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:47:15.275395 19132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "4de121ec693d4217b224e6d934d44ab8"
format_stamp: "Formatted at 2026-08-12 02:47:15 on dist-test-slave-2p8l"
server_key: "d9c8a615450e4a171ec4f0263b098508"
server_key_iv: "ff3bcf08272f5c6c7d2850246d121b48"
server_key_version: "encryptionkey@0"
I20260812 02:47:15.275978 19132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "4de121ec693d4217b224e6d934d44ab8"
format_stamp: "Formatted at 2026-08-12 02:47:15 on dist-test-slave-2p8l"
server_key: "d9c8a615450e4a171ec4f0263b098508"
server_key_iv: "ff3bcf08272f5c6c7d2850246d121b48"
server_key_version: "encryptionkey@0"
I20260812 02:47:15.279661 19132 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260812 02:47:15.281971 19162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:47:15.283196 19132 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 02:47:15.283344 19132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "4de121ec693d4217b224e6d934d44ab8"
format_stamp: "Formatted at 2026-08-12 02:47:15 on dist-test-slave-2p8l"
server_key: "d9c8a615450e4a171ec4f0263b098508"
server_key_iv: "ff3bcf08272f5c6c7d2850246d121b48"
server_key_version: "encryptionkey@0"
I20260812 02:47:15.283440 19132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:47:15.305430 19132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:47:15.308543 19132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:47:15.308758 19132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:47:15.316054 19132 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:44957
I20260812 02:47:15.316073 19261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:44957 every 8 connection(s)
I20260812 02:47:15.316991 19132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:47:15.320024 19262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:47:15.320570 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 19132
I20260812 02:47:15.320716 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:47:15.321025 10541 external_mini_cluster.cc:1428] Setting key f3e28c3f6f24603d34eeda0c1123af22
I20260812 02:47:15.326689 19262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8: Bootstrap starting.
I20260812 02:47:15.328805 19262 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8: Neither blocks nor log segments found. Creating new log.
I20260812 02:47:15.329617 19262 log.cc:824] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8: Log is configured to *not* fsync() on all Append() calls
I20260812 02:47:15.330005 19267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:15.322486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45279 (local address 127.10.75.126:44957)
0812 02:47:15.322946 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:15.322962 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:15.323000 (+ 38us) server_negotiation.cc:407] Connection header received
0812 02:47:15.323714 (+ 714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:15.323732 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:15.324056 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:15.324417 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:15.324836 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:15.325795 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:15.326748 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:15.327261 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:15.327438 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:15.328316 (+ 878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:15.328325 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:15.328337 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:47:15.328708 (+ 371us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:15.328762 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:47:15.328784 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:15.328890 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:15.329054 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 02:47:15.329256 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":133,"threads_started":1}
I20260812 02:47:15.331501 19262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8: No bootstrap required, opened a new log
I20260812 02:47:15.332823 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:47:15.335453 19262 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de121ec693d4217b224e6d934d44ab8" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44957 } }
I20260812 02:47:15.335732 19262 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:47:15.335819 19262 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de121ec693d4217b224e6d934d44ab8, State: Initialized, Role: FOLLOWER
I20260812 02:47:15.336267 19262 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de121ec693d4217b224e6d934d44ab8" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44957 } }
I20260812 02:47:15.336474 19262 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:47:15.336551 19262 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:47:15.336649 19262 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:47:15.337697 19262 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de121ec693d4217b224e6d934d44ab8" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44957 } }
I20260812 02:47:15.338124 19262 leader_election.cc:302] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4de121ec693d4217b224e6d934d44ab8; no voters:
I20260812 02:47:15.338455 19262 leader_election.cc:288] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:47:15.338560 19292 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:47:15.338855 19292 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8 [term 1 LEADER]: Becoming Leader. State: Replica: 4de121ec693d4217b224e6d934d44ab8, State: Running, Role: LEADER
I20260812 02:47:15.339161 19267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:15.334898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55507 (local address 127.10.75.126:44957)
0812 02:47:15.335029 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:15.335036 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:15.335178 (+ 142us) server_negotiation.cc:407] Connection header received
0812 02:47:15.335303 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:15.335305 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:15.335338 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:15.335401 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:15.335739 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:15.336318 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:15.337413 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:15.337677 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:15.337760 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:15.338690 (+ 930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:15.338695 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:15.338700 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:47:15.338715 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:15.338744 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:47:15.338758 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:15.338837 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:15.338987 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 02:47:15.339040 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 02:47:15.339321 19292 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de121ec693d4217b224e6d934d44ab8" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44957 } }
I20260812 02:47:15.339759 19262 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:47:15.340472 19292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4de121ec693d4217b224e6d934d44ab8. Latest consensus state: current_term: 1 leader_uuid: "4de121ec693d4217b224e6d934d44ab8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de121ec693d4217b224e6d934d44ab8" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44957 } } }
I20260812 02:47:15.340678 19292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8 [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:15.340945 19293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4de121ec693d4217b224e6d934d44ab8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de121ec693d4217b224e6d934d44ab8" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 44957 } } }
I20260812 02:47:15.341091 19293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8 [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:15.341148 19301 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:47:15.344111 19301 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:47:15.349607 19301 catalog_manager.cc:1347] Generated new cluster ID: fea4bedcf23c4a578ffd994715efc79f
I20260812 02:47:15.349679 19301 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:47:15.383471 19301 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:47:15.384490 19301 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:47:15.393318 19301 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4de121ec693d4217b224e6d934d44ab8: Generated new TSK 0
I20260812 02:47:15.394120 19301 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:47:15.407493 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 19132
2026-08-12T02:47:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1753 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:47:15 dist-test-slave-2p8l krb5kdc[19325](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:47:15 dist-test-slave-2p8l krb5kdc[19325](info): set up 2 sockets
Aug 12 02:47:15 dist-test-slave-2p8l krb5kdc[19325](info): commencing operation
krb5kdc: starting...
W20260812 02:47:16.703485 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:47:16 dist-test-slave-2p8l krb5kdc[19325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:47:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:47:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:47:16.829310 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:39263
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:43359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:39263
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:47:16.940891 19351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:47:16.941196 19351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:47:16.941289 19351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:47:16.945377 19351 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:47:16.945472 19351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:47:16.945513 19351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:47:16.945571 19351 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:47:16.945612 19351 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:47:16.951006 19351 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:43359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:39263
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:39263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:47:16.952052 19351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:47:16.953076 19351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:47:16.961938 19364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:16.961992 19351 server_base.cc:1034] running on GCE node
W20260812 02:47:16.961966 19367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:16.962011 19362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:16.962888 19351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:47:16.964031 19351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:47:16.965242 19351 hybrid_clock.cc:648] HybridClock initialized: now 1786502836965222 us; error 38 us; skew 500 ppm
Aug 12 02:47:16 dist-test-slave-2p8l krb5kdc[19325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502836, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:47:16.967988 19351 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:47:16.968920 19351 webserver.cc:460] Webserver started at http://127.10.75.126:42409/ using document root <none> and password file <none>
I20260812 02:47:16.969508 19351 fs_manager.cc:359] Metadata directory not provided
I20260812 02:47:16.969605 19351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:47:16.969853 19351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:47:16.972043 19351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "227e5a983df346f8aeaa4a105f508e6a"
format_stamp: "Formatted at 2026-08-12 02:47:16 on dist-test-slave-2p8l"
server_key: "48080bf38c81355f6853535533e9b23f"
server_key_iv: "d290410683a55e94567820bca951264d"
server_key_version: "encryptionkey@0"
I20260812 02:47:16.972635 19351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "227e5a983df346f8aeaa4a105f508e6a"
format_stamp: "Formatted at 2026-08-12 02:47:16 on dist-test-slave-2p8l"
server_key: "48080bf38c81355f6853535533e9b23f"
server_key_iv: "d290410683a55e94567820bca951264d"
server_key_version: "encryptionkey@0"
I20260812 02:47:16.976485 19351 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260812 02:47:16.978855 19376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:47:16.980041 19351 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:47:16.980201 19351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "227e5a983df346f8aeaa4a105f508e6a"
format_stamp: "Formatted at 2026-08-12 02:47:16 on dist-test-slave-2p8l"
server_key: "48080bf38c81355f6853535533e9b23f"
server_key_iv: "d290410683a55e94567820bca951264d"
server_key_version: "encryptionkey@0"
I20260812 02:47:16.980332 19351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:47:16.984972 19351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:47:16.987936 19351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:47:16.988142 19351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:47:16.995193 19351 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:39263
I20260812 02:47:16.995217 19473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:39263 every 8 connection(s)
I20260812 02:47:16.996155 19351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:47:16.998890 19474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:47:17.004316 19474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a: Bootstrap starting.
I20260812 02:47:17.006254 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 19351
I20260812 02:47:17.006405 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:47:17.006692 10541 external_mini_cluster.cc:1428] Setting key 622221d9a6ab1f754279797f19c39815
I20260812 02:47:17.006927 19474 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a: Neither blocks nor log segments found. Creating new log.
I20260812 02:47:17.007776 19474 log.cc:824] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a: Log is configured to *not* fsync() on all Append() calls
I20260812 02:47:17.009999 19474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a: No bootstrap required, opened a new log
I20260812 02:47:17.012506 19482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:17.007835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40775 (local address 127.10.75.126:39263)
0812 02:47:17.008338 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:17.008359 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:17.008410 (+ 51us) server_negotiation.cc:407] Connection header received
0812 02:47:17.009261 (+ 851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:17.009284 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:17.009619 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:17.009977 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:17.011104 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:17.011110 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:17.011125 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:47:17.011138 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:17.011205 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:47:17.011235 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:17.011350 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:17.011442 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 02:47:17.011596 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":141,"threads_started":1}
I20260812 02:47:17.014817 19474 raft_consensus.cc:348] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "227e5a983df346f8aeaa4a105f508e6a" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39263 } }
I20260812 02:47:17.015067 19474 raft_consensus.cc:374] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 02:47:17.015156 19474 raft_consensus.cc:729] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e5a983df346f8aeaa4a105f508e6a, State: Initialized, Role: FOLLOWER
I20260812 02:47:17.015455 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:47:17.015650 19474 consensus_queue.cc:260] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "227e5a983df346f8aeaa4a105f508e6a" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39263 } }
I20260812 02:47:17.015808 19474 raft_consensus.cc:388] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 02:47:17.015875 19474 raft_consensus.cc:482] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 02:47:17.015972 19474 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:47:17.016961 19474 raft_consensus.cc:504] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "227e5a983df346f8aeaa4a105f508e6a" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39263 } }
I20260812 02:47:17.017306 19474 leader_election.cc:302] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 227e5a983df346f8aeaa4a105f508e6a; no voters:
I20260812 02:47:17.017690 19474 leader_election.cc:288] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 02:47:17.017792 19491 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:47:17.018096 19491 raft_consensus.cc:686] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a [term 1 LEADER]: Becoming Leader. State: Replica: 227e5a983df346f8aeaa4a105f508e6a, State: Running, Role: LEADER
I20260812 02:47:17.018474 19491 consensus_queue.cc:237] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "227e5a983df346f8aeaa4a105f508e6a" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39263 } }
I20260812 02:47:17.019192 19474 sys_catalog.cc:564] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:47:17.019655 19482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:17.017622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44903 (local address 127.10.75.126:39263)
0812 02:47:17.017753 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:17.017760 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:17.018033 (+ 273us) server_negotiation.cc:407] Connection header received
0812 02:47:17.018230 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:17.018234 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:17.018268 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:17.018318 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:17.019118 (+ 800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:17.019121 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:17.019124 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 02:47:17.019136 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:17.019163 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 02:47:17.019177 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:17.019297 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:17.019479 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 02:47:17.019526 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 02:47:17.020033 19491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "227e5a983df346f8aeaa4a105f508e6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "227e5a983df346f8aeaa4a105f508e6a" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39263 } } }
I20260812 02:47:17.020166 19491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:17.020807 19496 sys_catalog.cc:455] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 227e5a983df346f8aeaa4a105f508e6a. Latest consensus state: current_term: 1 leader_uuid: "227e5a983df346f8aeaa4a105f508e6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "227e5a983df346f8aeaa4a105f508e6a" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 39263 } } }
I20260812 02:47:17.020916 19496 sys_catalog.cc:458] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a [sys.catalog]: This master's current role is: LEADER
W20260812 02:47:17.024618 19521 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:47:17.024718 19521 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:47:17.024791 19506 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:47:17.025506 19506 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:47:17.031165 19506 catalog_manager.cc:1347] Generated new cluster ID: 4c5fc8904193470596fff23324e77ee1
I20260812 02:47:17.031239 19506 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:47:17.048821 19506 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:47:17.049161 19506 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:47:17.061959 19506 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 227e5a983df346f8aeaa4a105f508e6a: Generated new TSK 0
I20260812 02:47:17.062688 19506 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 02:47:17.067868 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 19351
2026-08-12T02:47:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1663 ms)
[----------] 18 tests from AuthTokenIssuingTest (30999 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:47:17 dist-test-slave-2p8l krb5kdc[19530](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:47:17 dist-test-slave-2p8l krb5kdc[19530](info): set up 2 sockets
Aug 12 02:47:17 dist-test-slave-2p8l krb5kdc[19530](info): commencing operation
krb5kdc: starting...
W20260812 02:47:18.380456 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:47:18 dist-test-slave-2p8l krb5kdc[19530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:47:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:47:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:47:18.505442 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:41759
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:41995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:41759,127.10.75.125:44907,127.10.75.124:44807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:47:18.616894 19555 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 02:47:18.617166 19555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:47:18.617190 19555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:47:18.617271 19555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:47:18.621378 19555 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:47:18.621443 19555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:47:18.621462 19555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:47:18.621480 19555 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:47:18.621533 19555 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:47:18.626894 19555 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:41995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:41759,127.10.75.125:44907,127.10.75.124:44807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:41759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19555
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:47:18.628057 19555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:47:18.629094 19555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:47:18.637760 19566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:18.637809 19564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:18.637790 19572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:18.637846 19555 server_base.cc:1034] running on GCE node
I20260812 02:47:18.638569 19555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:47:18.639649 19555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:47:18.640852 19555 hybrid_clock.cc:648] HybridClock initialized: now 1786502838640835 us; error 34 us; skew 500 ppm
Aug 12 02:47:18 dist-test-slave-2p8l krb5kdc[19530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502838, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:47:18.649269 19555 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:47:18.650316 19555 webserver.cc:460] Webserver started at http://127.10.75.126:40817/ using document root <none> and password file <none>
I20260812 02:47:18.650916 19555 fs_manager.cc:359] Metadata directory not provided
I20260812 02:47:18.651014 19555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:47:18.651259 19555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:47:18.653324 19555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "852ad8142d164ff58464d449fa079b81"
format_stamp: "Formatted at 2026-08-12 02:47:18 on dist-test-slave-2p8l"
server_key: "7af420e88ea2dca111b5d11a1cda2de6"
server_key_iv: "eb340f704ea22ba645a5cc5c01dcf4d9"
server_key_version: "encryptionkey@0"
I20260812 02:47:18.653945 19555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "852ad8142d164ff58464d449fa079b81"
format_stamp: "Formatted at 2026-08-12 02:47:18 on dist-test-slave-2p8l"
server_key: "7af420e88ea2dca111b5d11a1cda2de6"
server_key_iv: "eb340f704ea22ba645a5cc5c01dcf4d9"
server_key_version: "encryptionkey@0"
I20260812 02:47:18.657660 19555 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 02:47:18.660162 19580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:47:18.661402 19555 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:47:18.661549 19555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "852ad8142d164ff58464d449fa079b81"
format_stamp: "Formatted at 2026-08-12 02:47:18 on dist-test-slave-2p8l"
server_key: "7af420e88ea2dca111b5d11a1cda2de6"
server_key_iv: "eb340f704ea22ba645a5cc5c01dcf4d9"
server_key_version: "encryptionkey@0"
I20260812 02:47:18.661667 19555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:47:18.689091 19555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:47:18.692140 19555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:47:18.692353 19555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:47:18.699728 19555 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:41759
I20260812 02:47:18.700050 19673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:41759 every 8 connection(s)
I20260812 02:47:18.700704 19555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:47:18.702140 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 19555
I20260812 02:47:18.702296 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:47:18.702579 10541 external_mini_cluster.cc:1428] Setting key 50de0ac2a488f68b3b9ffb3036f007cc
I20260812 02:47:18.703648 19676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:47:18.707823 19676 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.10.75.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.125@KRBTEST.COM" created.
Aug 12 02:47:18 dist-test-slave-2p8l krb5kdc[19530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502838, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:47:18.724555 19679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.710138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59232 (local address 127.10.75.126:41759)
0812 02:47:18.710639 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:18.710660 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:18.710924 (+ 264us) server_negotiation.cc:407] Connection header received
0812 02:47:18.711971 (+ 1047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:18.711976 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:18.712146 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:18.712381 (+ 235us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:18.713191 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:18.714462 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:18.716232 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:18.716894 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:18.717080 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:18.719713 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:18.719719 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:18.719728 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:18.719750 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:18.721430 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:18.721938 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:18.721951 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:18.721953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:18.722052 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:18.722400 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:18.722405 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:18.722407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:18.722773 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:18.722914 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:18.723278 (+ 364us) server_negotiation.cc:299] Negotiation successful
0812 02:47:18.723518 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":144,"threads_started":1}
I20260812 02:47:18.724555 19682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.710138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:41759 (local address 127.0.0.1:59232)
0812 02:47:18.710750 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:18.710796 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 02:47:18.711683 (+ 887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:47:18.712375 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:47:18.712383 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:47:18.712783 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:47:18.713037 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:18.713052 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:18.714646 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:18.714681 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:18.716068 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:18.716086 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:18.717092 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:18.717096 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:18.717206 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:18.717818 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:47:18.717835 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:47:18.719545 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:47:18.721558 (+ 2013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:18.721570 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:18.721579 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:18.721822 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:18.722186 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:18.722189 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:18.722191 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:18.722304 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:18.722899 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:47:18.722905 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:47:18.723038 (+ 133us) client_negotiation.cc:769] Sending connection context
0812 02:47:18.723214 (+ 176us) client_negotiation.cc:240] Negotiation successful
0812 02:47:18.723598 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"mutex_wait_us":105,"spinlock_wait_cycles":55552,"thread_start_us":157,"threads_started":1}
I20260812 02:47:18.726948 19676 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } has no permanent_uuid. Determining permanent_uuid...
I20260812 02:47:18.727741 19682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.727471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:44907 (local address 127.0.0.1:48136)
0812 02:47:18.727578 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:18.727647 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.125:44907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 02:47:18.728044 19583 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.75.125:44907: connect: Connection refused (error 111)
I20260812 02:47:18.728986 19682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.728757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:44907 (local address 127.0.0.1:48138)
0812 02:47:18.728852 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:18.728895 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.125:44907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 02:47:18.729166 19676 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.125:44907: Network error: Client connection negotiation failed: client connection to 127.10.75.125:44907: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.125.keytab.
Entry for principal kudu/127.10.75.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.125.keytab.
I20260812 02:47:18.731200 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.125:44907
--webserver_interface=127.10.75.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.125.keytab
--principal=kudu/127.10.75.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:41995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:41759,127.10.75.125:44907,127.10.75.124:44807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:47:18.778396 19676 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } attempt: 1
I20260812 02:47:18.779371 19682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.779040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:44907 (local address 127.0.0.1:48144)
0812 02:47:18.779224 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:18.779288 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.125:44907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260812 02:47:18.780161 19682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.779926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:44907 (local address 127.0.0.1:48160)
0812 02:47:18.780041 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:18.780094 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.125:44907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 02:47:18.780297 19676 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.125:44907: Network error: Client connection negotiation failed: client connection to 127.10.75.125:44907: connect: Connection refused (error 111)
W20260812 02:47:18.845675 19688 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 02:47:18.845984 19688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:47:18.846060 19688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:47:18.846160 19688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 02:47:18.848465 19676 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } attempt: 2
I20260812 02:47:18.849287 19682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.848980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:44907 (local address 127.0.0.1:48176)
0812 02:47:18.849138 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:18.849207 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.125:44907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 02:47:18.850004 19682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.849785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:44907 (local address 127.0.0.1:48192)
0812 02:47:18.849896 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:18.849950 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.125:44907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 02:47:18.850190 19676 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.125:44907: Network error: Client connection negotiation failed: client connection to 127.10.75.125:44907: connect: Connection refused (error 111)
W20260812 02:47:18.850543 19688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:47:18.850585 19688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:47:18.850662 19688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:47:18.850703 19688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:47:18.850740 19688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:47:18.856071 19688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:41995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:41759,127.10.75.125:44907,127.10.75.124:44807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.125.keytab
--principal=kudu/127.10.75.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.125:44907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.75.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:47:18.857128 19688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:47:18.858199 19688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:47:18.866578 19695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:18.866585 19696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:18.866756 19688 server_base.cc:1034] running on GCE node
W20260812 02:47:18.866592 19702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:18.867435 19688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:47:18.868484 19688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:47:18.869681 19688 hybrid_clock.cc:648] HybridClock initialized: now 1786502838869669 us; error 25 us; skew 500 ppm
Aug 12 02:47:18 dist-test-slave-2p8l krb5kdc[19530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502838, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:47:18.872570 19688 init.cc:377] Logged in from keytab as kudu/127.10.75.125@KRBTEST.COM (short username kudu)
I20260812 02:47:18.873526 19688 webserver.cc:460] Webserver started at http://127.10.75.125:39781/ using document root <none> and password file <none>
I20260812 02:47:18.874157 19688 fs_manager.cc:359] Metadata directory not provided
I20260812 02:47:18.874254 19688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:47:18.874469 19688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:47:18.876492 19688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-1/data/instance:
uuid: "ebb45d8882d3489ba874e39ca7a8116d"
format_stamp: "Formatted at 2026-08-12 02:47:18 on dist-test-slave-2p8l"
server_key: "5871ef7b3d659ddd36a04f8b41ba00bc"
server_key_iv: "dd5deb42cf93f8ef3447be0d06e90407"
server_key_version: "encryptionkey@0"
I20260812 02:47:18.877074 19688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-1/wal/instance:
uuid: "ebb45d8882d3489ba874e39ca7a8116d"
format_stamp: "Formatted at 2026-08-12 02:47:18 on dist-test-slave-2p8l"
server_key: "5871ef7b3d659ddd36a04f8b41ba00bc"
server_key_iv: "dd5deb42cf93f8ef3447be0d06e90407"
server_key_version: "encryptionkey@0"
I20260812 02:47:18.880806 19688 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260812 02:47:18.883303 19715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:47:18.884549 19688 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:47:18.884693 19688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-1/wal
uuid: "ebb45d8882d3489ba874e39ca7a8116d"
format_stamp: "Formatted at 2026-08-12 02:47:18 on dist-test-slave-2p8l"
server_key: "5871ef7b3d659ddd36a04f8b41ba00bc"
server_key_iv: "dd5deb42cf93f8ef3447be0d06e90407"
server_key_version: "encryptionkey@0"
I20260812 02:47:18.884814 19688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:47:18.902824 19688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:47:18.905732 19688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:47:18.905951 19688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:47:18.913113 19688 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.125:44907
I20260812 02:47:18.913406 19812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.125:44907 every 8 connection(s)
I20260812 02:47:18.914108 19688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-1/data/info.pb
I20260812 02:47:18.916812 19813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:47:18.918210 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 19688
I20260812 02:47:18.918362 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-1/wal/instance
I20260812 02:47:18.918665 10541 external_mini_cluster.cc:1428] Setting key 725bc551174fb7f71c8a65a16b902a96
I20260812 02:47:18.920926 19813 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.10.75.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.124@KRBTEST.COM" created.
Aug 12 02:47:18 dist-test-slave-2p8l krb5kdc[19530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502838, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.125@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:47:18.940740 19679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.923875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59238 (local address 127.10.75.126:41759)
0812 02:47:18.924140 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:18.924145 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:18.925422 (+ 1277us) server_negotiation.cc:407] Connection header received
0812 02:47:18.925784 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:18.925789 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:18.925856 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:18.925968 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:18.927634 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:18.928783 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:18.930767 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:18.931113 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:18.931200 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:18.936379 (+ 5179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:18.936386 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:18.936392 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:18.936431 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:18.938168 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:18.938861 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:18.938864 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:18.938865 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:18.938945 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:18.939406 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:18.939410 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:18.939411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:18.939603 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:18.939697 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:18.940485 (+ 788us) server_negotiation.cc:299] Negotiation successful
0812 02:47:18.940610 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
I20260812 02:47:18.941366 19676 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } attempt: 3
I20260812 02:47:18.941937 19818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.923714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:41759 (local address 127.0.0.1:59238)
0812 02:47:18.924306 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:18.924371 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 02:47:18.925533 (+ 1162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:47:18.926201 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:47:18.926211 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:47:18.926682 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:47:18.927411 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:18.927441 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:18.928983 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:18.928990 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:18.930629 (+ 1639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:18.930644 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:18.931395 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:18.931400 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:18.931602 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:18.932438 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:47:18.932454 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:47:18.936179 (+ 3725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:47:18.938296 (+ 2117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:18.938306 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:18.938324 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:18.938724 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:18.939043 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:18.939049 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:18.939054 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:18.939257 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:18.939728 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:47:18.939745 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:47:18.940138 (+ 393us) client_negotiation.cc:769] Sending connection context
0812 02:47:18.940365 (+ 227us) client_negotiation.cc:240] Negotiation successful
0812 02:47:18.940775 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":150,"threads_started":1}
I20260812 02:47:18.943830 19813 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 02:47:18 dist-test-slave-2p8l krb5kdc[19530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502838, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for kudu/127.10.75.125@KRBTEST.COM
Aug 12 02:47:18 dist-test-slave-2p8l krb5kdc[19530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502838, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.125@KRBTEST.COM for kudu/127.10.75.125@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.124.keytab.
Entry for principal kudu/127.10.75.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.124.keytab.
I20260812 02:47:18.952809 19682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.941850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:44907 (local address 127.0.0.1:48196)
0812 02:47:18.942051 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:18.942090 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 02:47:18.942174 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:47:18.942875 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:47:18.942878 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:47:18.943059 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:47:18.943141 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:18.943146 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:18.944462 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:18.944468 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:18.945193 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:18.945202 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:18.945963 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:18.945966 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:18.946163 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:18.946766 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:47:18.946781 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:47:18.948313 (+ 1532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:47:18.950628 (+ 2315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:18.950634 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:18.950639 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:18.950978 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:18.951423 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:18.951427 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:18.951428 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:18.951569 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:18.952195 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:47:18.952197 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:47:18.952281 (+ 84us) client_negotiation.cc:769] Sending connection context
0812 02:47:18.952372 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 02:47:18.952536 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110}
I20260812 02:47:18.952924 19821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.941944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48196 (local address 127.10.75.125:44907)
0812 02:47:18.942503 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:18.942511 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:18.942530 (+ 19us) server_negotiation.cc:407] Connection header received
0812 02:47:18.942564 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:18.942568 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:18.942709 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:18.943263 (+ 554us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:18.943352 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:18.944318 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:18.945310 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:18.945841 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:18.945945 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:18.948483 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:18.948495 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:18.948511 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:18.948535 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:18.950427 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:18.951153 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:18.951160 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:18.951163 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:18.951309 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:18.951664 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:18.951668 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:18.951670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:18.952062 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:18.952210 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:18.952539 (+ 329us) server_negotiation.cc:299] Negotiation successful
0812 02:47:18.952700 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":8,"server-negotiator.queue_time_us":476,"thread_start_us":163,"threads_started":1}
I20260812 02:47:18.953748 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.124:44807
--webserver_interface=127.10.75.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.124.keytab
--principal=kudu/127.10.75.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:41995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:41759,127.10.75.125:44907,127.10.75.124:44807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:47:18.954416 19818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.944347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:44907 (local address 127.0.0.1:48206)
0812 02:47:18.944552 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:18.944568 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:47:18.944653 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:47:18.944954 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:47:18.944957 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:47:18.945132 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:47:18.945281 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:18.945289 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:18.946278 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:18.946281 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:18.947093 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:18.947105 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:18.947726 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:18.947729 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:18.947892 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:18.948336 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:47:18.948347 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:47:18.949887 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:47:18.952703 (+ 2816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:18.952706 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:18.952708 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:18.952933 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:18.953256 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:18.953259 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:18.953261 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:18.953365 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:18.953725 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:47:18.953728 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:47:18.953836 (+ 108us) client_negotiation.cc:769] Sending connection context
0812 02:47:18.953963 (+ 127us) client_negotiation.cc:240] Negotiation successful
0812 02:47:18.954155 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":1}
I20260812 02:47:18.954427 19822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.944397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48206 (local address 127.10.75.125:44907)
0812 02:47:18.944731 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:18.944740 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:18.944753 (+ 13us) server_negotiation.cc:407] Connection header received
0812 02:47:18.944786 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:18.944789 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:18.944826 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:18.944914 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:18.945400 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:18.946170 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:18.947232 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:18.947597 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:18.947714 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:18.950023 (+ 2309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:18.950029 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:18.950032 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:18.950056 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:18.952590 (+ 2534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:18.953046 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:18.953051 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:18.953053 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:18.953132 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:18.953468 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:18.953470 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:18.953471 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:18.953620 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:18.953694 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:18.954033 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 02:47:18.954224 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":272,"thread_start_us":127,"threads_started":1}
I20260812 02:47:18.956393 19813 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } has no permanent_uuid. Determining permanent_uuid...
I20260812 02:47:18.956560 19676 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } has no permanent_uuid. Determining permanent_uuid...
I20260812 02:47:18.957248 19818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.956907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44807 (local address 127.0.0.1:53254)
0812 02:47:18.957054 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:18.957165 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260812 02:47:18.957424 19682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.957172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44807 (local address 127.0.0.1:53260)
0812 02:47:18.957295 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:18.957350 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260812 02:47:18.957495 19718 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44807: connect: Connection refused (error 111)
I20260812 02:47:18.958482 19818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.958177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44807 (local address 127.0.0.1:53276)
0812 02:47:18.958324 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:18.958394 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 02:47:18.958905 19682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.958629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44807 (local address 127.0.0.1:53292)
0812 02:47:18.958783 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:18.958838 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
W20260812 02:47:18.958880 19813 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:44807: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44807: connect: Connection refused (error 111)
W20260812 02:47:18.959106 19676 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:44807: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44807: connect: Connection refused (error 111)
I20260812 02:47:18.990298 19676 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } attempt: 1
I20260812 02:47:18.991112 19682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.990805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44807 (local address 127.0.0.1:53308)
0812 02:47:18.990965 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:18.991031 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260812 02:47:18.991904 19682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:18.991666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44807 (local address 127.0.0.1:53316)
0812 02:47:18.991796 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:18.991848 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 02:47:18.992115 19676 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:44807: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44807: connect: Connection refused (error 111)
I20260812 02:47:19.008184 19813 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } attempt: 1
I20260812 02:47:19.009042 19818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.008711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44807 (local address 127.0.0.1:53318)
0812 02:47:19.008879 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:19.008952 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 02:47:19.009842 19818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.009602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44807 (local address 127.0.0.1:53328)
0812 02:47:19.009722 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:19.009778 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 02:47:19.010097 19813 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:44807: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44807: connect: Connection refused (error 111)
I20260812 02:47:19.067318 19676 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } attempt: 2
I20260812 02:47:19.068169 19682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.067824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44807 (local address 127.0.0.1:53338)
0812 02:47:19.067974 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:19.068052 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 02:47:19.069628 19682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.069338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44807 (local address 127.0.0.1:53342)
0812 02:47:19.069495 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:19.069562 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 02:47:19.069850 19676 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:44807: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44807: connect: Connection refused (error 111)
W20260812 02:47:19.073438 19826 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 02:47:19.073693 19826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:47:19.073781 19826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:47:19.073850 19826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:47:19.077829 19826 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:47:19.077879 19826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:47:19.077898 19826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:47:19.077957 19826 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:47:19.077988 19826 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:47:19.078262 19813 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } attempt: 2
I20260812 02:47:19.078960 19818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.078666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44807 (local address 127.0.0.1:53350)
0812 02:47:19.078817 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:19.078881 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260812 02:47:19.079707 19818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.079458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44807 (local address 127.0.0.1:53366)
0812 02:47:19.079576 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:19.079626 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 02:47:19.079847 19813 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:44807: Network error: Client connection negotiation failed: client connection to 127.10.75.124:44807: connect: Connection refused (error 111)
I20260812 02:47:19.083743 19826 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:41995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:41759,127.10.75.125:44907,127.10.75.124:44807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.124.keytab
--principal=kudu/127.10.75.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.124:44807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.75.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:47:19.084775 19826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:47:19.085784 19826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:47:19.094812 19841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:19.094846 19826 server_base.cc:1034] running on GCE node
W20260812 02:47:19.094777 19842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:19.094796 19844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:19.095530 19826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:47:19.096657 19826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:47:19.097847 19826 hybrid_clock.cc:648] HybridClock initialized: now 1786502839097823 us; error 48 us; skew 500 ppm
Aug 12 02:47:19 dist-test-slave-2p8l krb5kdc[19530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502839, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:47:19.100780 19826 init.cc:377] Logged in from keytab as kudu/127.10.75.124@KRBTEST.COM (short username kudu)
I20260812 02:47:19.101643 19826 webserver.cc:460] Webserver started at http://127.10.75.124:39181/ using document root <none> and password file <none>
I20260812 02:47:19.102270 19826 fs_manager.cc:359] Metadata directory not provided
I20260812 02:47:19.102360 19826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:47:19.102560 19826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:47:19.104604 19826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-2/data/instance:
uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680"
format_stamp: "Formatted at 2026-08-12 02:47:19 on dist-test-slave-2p8l"
server_key: "754bc0e8f7f3e8899c3daeff3e40a19a"
server_key_iv: "1ca07ad4708566b0d1673c0c755dc17c"
server_key_version: "encryptionkey@0"
I20260812 02:47:19.105170 19826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-2/wal/instance:
uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680"
format_stamp: "Formatted at 2026-08-12 02:47:19 on dist-test-slave-2p8l"
server_key: "754bc0e8f7f3e8899c3daeff3e40a19a"
server_key_iv: "1ca07ad4708566b0d1673c0c755dc17c"
server_key_version: "encryptionkey@0"
I20260812 02:47:19.108881 19826 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260812 02:47:19.111271 19855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:47:19.112465 19826 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 02:47:19.112608 19826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-2/wal
uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680"
format_stamp: "Formatted at 2026-08-12 02:47:19 on dist-test-slave-2p8l"
server_key: "754bc0e8f7f3e8899c3daeff3e40a19a"
server_key_iv: "1ca07ad4708566b0d1673c0c755dc17c"
server_key_version: "encryptionkey@0"
I20260812 02:47:19.112743 19826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:47:19.136893 19826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:47:19.140215 19826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:47:19.140425 19826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:47:19.147682 19826 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.124:44807
I20260812 02:47:19.147962 19955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.124:44807 every 8 connection(s)
I20260812 02:47:19.148658 19826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-2/data/info.pb
I20260812 02:47:19.151443 19956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:47:19.151780 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 19826
I20260812 02:47:19.151919 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786502539688512-10541-0/minicluster-data/master-2/wal/instance
I20260812 02:47:19.152209 10541 external_mini_cluster.cc:1428] Setting key 5f61eac2ddd9c2a3b61784d5146a8bb0
I20260812 02:47:19.156510 19956 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 02:47:19 dist-test-slave-2p8l krb5kdc[19530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.124@KRBTEST.COM
Aug 12 02:47:19 dist-test-slave-2p8l krb5kdc[19530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502839, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.124@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:47:19.167960 19962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.153580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53378 (local address 127.10.75.124:44807)
0812 02:47:19.154011 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.154029 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.154098 (+ 69us) server_negotiation.cc:407] Connection header received
0812 02:47:19.154862 (+ 764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.154886 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.155316 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.155680 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.156354 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.157788 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.159059 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.159704 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.159882 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:19.162536 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:19.162546 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:19.162561 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:19.162593 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:19.164532 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.165056 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.165064 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.165072 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.165207 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.165529 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.165533 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.165536 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.166034 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:19.166298 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:19.166595 (+ 297us) server_negotiation.cc:299] Negotiation successful
0812 02:47:19.166913 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":112,"threads_started":1}
I20260812 02:47:19.168080 19679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.158533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59248 (local address 127.10.75.126:41759)
0812 02:47:19.158715 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.158720 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.158979 (+ 259us) server_negotiation.cc:407] Connection header received
0812 02:47:19.159170 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.159173 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.159227 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.159311 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.160057 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.160550 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.161443 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.161664 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.161787 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:19.164530 (+ 2743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:19.164534 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:19.164536 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:19.164560 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:19.166288 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.166836 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.166839 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.166841 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.166917 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.167209 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.167212 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.167213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.167388 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:19.167466 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:19.167844 (+ 378us) server_negotiation.cc:299] Negotiation successful
0812 02:47:19.167937 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 02:47:19.168191 19966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.158399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:41759 (local address 127.0.0.1:59248)
0812 02:47:19.158840 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:19.158889 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 02:47:19.159007 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:47:19.159368 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:47:19.159372 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:47:19.159778 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:47:19.159924 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:19.159930 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.160680 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.160690 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:19.161301 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:19.161310 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.161831 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.161836 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:19.161972 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:19.162625 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:47:19.162640 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:47:19.164361 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:47:19.166408 (+ 2047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:19.166432 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:19.166440 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:19.166712 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:19.167009 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:19.167012 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:19.167014 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:19.167102 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:19.167496 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:47:19.167502 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:47:19.167618 (+ 116us) client_negotiation.cc:769] Sending connection context
0812 02:47:19.167779 (+ 161us) client_negotiation.cc:240] Negotiation successful
0812 02:47:19.167945 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"spinlock_wait_cycles":8960,"thread_start_us":149,"threads_started":1}
I20260812 02:47:19.169029 19676 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } attempt: 3
I20260812 02:47:19.170101 19956 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } has no permanent_uuid. Determining permanent_uuid...
I20260812 02:47:19.170998 19813 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } attempt: 3
Aug 12 02:47:19 dist-test-slave-2p8l krb5kdc[19530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502838, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for kudu/127.10.75.124@KRBTEST.COM
Aug 12 02:47:19 dist-test-slave-2p8l krb5kdc[19530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502839, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.124@KRBTEST.COM for kudu/127.10.75.125@KRBTEST.COM
Aug 12 02:47:19 dist-test-slave-2p8l krb5kdc[19530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
Aug 12 02:47:19 dist-test-slave-2p8l krb5kdc[19530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502838, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.125@KRBTEST.COM for kudu/127.10.75.124@KRBTEST.COM
I20260812 02:47:19.181191 19682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.169451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44807 (local address 127.0.0.1:53392)
0812 02:47:19.170041 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:19.170080 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 02:47:19.170181 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:47:19.170487 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:47:19.170491 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:47:19.170683 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:47:19.170817 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:19.170825 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.171888 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.171891 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:19.172699 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:19.172711 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.173420 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.173424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:19.173508 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:19.174025 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:47:19.174123 (+ 98us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:47:19.175740 (+ 1617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:47:19.177751 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:19.177757 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:19.177759 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:19.178118 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:19.179423 (+ 1305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:19.179429 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:19.179432 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:19.179810 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:19.180586 (+ 776us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:47:19.180589 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:47:19.180707 (+ 118us) client_negotiation.cc:769] Sending connection context
0812 02:47:19.180818 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 02:47:19.180965 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"spinlock_wait_cycles":1920}
I20260812 02:47:19.181757 19962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.169534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53392 (local address 127.10.75.124:44807)
0812 02:47:19.169685 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.169689 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.170142 (+ 453us) server_negotiation.cc:407] Connection header received
0812 02:47:19.170288 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.170291 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.170338 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.170934 (+ 596us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.171048 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.171763 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.172842 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.173289 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.173726 (+ 437us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:19.175908 (+ 2182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:19.175912 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:19.175915 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:19.175940 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:19.177609 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.178705 (+ 1096us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.178708 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.178710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.179289 (+ 579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.179952 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.179957 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.179959 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.180461 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:19.181365 (+ 904us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:19.181447 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 02:47:19.181565 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":50}
I20260812 02:47:19.181818 19679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.170545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59264 (local address 127.10.75.126:41759)
0812 02:47:19.170651 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.170655 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.170669 (+ 14us) server_negotiation.cc:407] Connection header received
0812 02:47:19.170706 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.170710 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.170808 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.170889 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.171715 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.172424 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.173599 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.173927 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.174011 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:19.177858 (+ 3847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:19.177862 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:19.177864 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:19.177895 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:19.179688 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.180195 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.180200 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.180203 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.180305 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.180666 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.180670 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.180672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.180910 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:19.181129 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:19.181504 (+ 375us) server_negotiation.cc:299] Negotiation successful
0812 02:47:19.181648 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41,"spinlock_wait_cycles":98304}
I20260812 02:47:19.182435 19822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.170837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48218 (local address 127.10.75.125:44907)
0812 02:47:19.170973 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.170977 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.170990 (+ 13us) server_negotiation.cc:407] Connection header received
0812 02:47:19.171036 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.171039 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.171087 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.171165 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.172250 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.172996 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.174126 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.174485 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.174576 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:19.177945 (+ 3369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:19.177950 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:19.177953 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:19.177975 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:19.179856 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.180684 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.180687 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.180689 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.180764 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.181098 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.181101 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.181102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.181401 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:19.181474 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:19.182123 (+ 649us) server_negotiation.cc:299] Negotiation successful
0812 02:47:19.182243 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1402,"server-negotiator.queue_time_us":62}
I20260812 02:47:19.183076 19966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.170553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:44907 (local address 127.0.0.1:48218)
0812 02:47:19.170820 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:19.170835 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:47:19.170899 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:47:19.171810 (+ 911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:47:19.171815 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:47:19.171988 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:47:19.172105 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:19.172112 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.173113 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.173116 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:19.173918 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:19.173927 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.174699 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.174705 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:19.174815 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:19.175250 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:47:19.175265 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:47:19.177806 (+ 2541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:47:19.179977 (+ 2171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:19.179983 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:19.179986 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:19.180569 (+ 583us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:19.180899 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:19.180902 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:19.180904 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:19.180991 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:19.181787 (+ 796us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:47:19.181790 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:47:19.181890 (+ 100us) client_negotiation.cc:769] Sending connection context
0812 02:47:19.182784 (+ 894us) client_negotiation.cc:240] Negotiation successful
0812 02:47:19.182917 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":2}
I20260812 02:47:19.183090 19818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.171399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44807 (local address 127.0.0.1:53404)
0812 02:47:19.171633 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:19.171645 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 02:47:19.171709 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:47:19.172190 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:47:19.172193 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:47:19.172368 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:47:19.172460 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:19.172470 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.174342 (+ 1872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.174346 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:19.175872 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:19.175884 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.176647 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.176650 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:19.176934 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:19.177362 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:47:19.177384 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:47:19.178936 (+ 1552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:47:19.181448 (+ 2512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:19.181453 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:19.181455 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:19.181700 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:19.182053 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:19.182081 (+ 28us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:19.182083 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:19.182170 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:19.182615 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:47:19.182621 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:47:19.182711 (+ 90us) client_negotiation.cc:769] Sending connection context
0812 02:47:19.182819 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 02:47:19.182954 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157}
I20260812 02:47:19.183694 19967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.171642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53404 (local address 127.10.75.124:44807)
0812 02:47:19.171948 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.171961 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.171973 (+ 12us) server_negotiation.cc:407] Connection header received
0812 02:47:19.172006 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.172009 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.172053 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.172573 (+ 520us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.172657 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.174218 (+ 1561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.176108 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.176517 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.176639 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:19.179102 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:19.179109 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:19.179113 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:19.179141 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:19.181173 (+ 2032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.181836 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.181840 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.181844 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.181948 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.182309 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.182311 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.182312 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.182461 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:19.183271 (+ 810us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:19.183348 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 02:47:19.183490 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":246,"spinlock_wait_cycles":2560,"thread_start_us":127,"threads_started":1}
I20260812 02:47:19.184230 19956 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } has no permanent_uuid. Determining permanent_uuid...
I20260812 02:47:19.186645 19676 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81: Bootstrap starting.
I20260812 02:47:19.186906 19813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d: Bootstrap starting.
Aug 12 02:47:19 dist-test-slave-2p8l krb5kdc[19530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502839, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.124@KRBTEST.COM for kudu/127.10.75.124@KRBTEST.COM
I20260812 02:47:19.189558 19676 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81: Neither blocks nor log segments found. Creating new log.
I20260812 02:47:19.189554 19813 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d: Neither blocks nor log segments found. Creating new log.
I20260812 02:47:19.190591 19813 log.cc:824] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d: Log is configured to *not* fsync() on all Append() calls
I20260812 02:47:19.190644 19676 log.cc:824] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81: Log is configured to *not* fsync() on all Append() calls
Aug 12 02:47:19 dist-test-slave-2p8l krb5kdc[19530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.125@KRBTEST.COM
I20260812 02:47:19.193003 19813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d: No bootstrap required, opened a new log
I20260812 02:47:19.193660 19676 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81: No bootstrap required, opened a new log
I20260812 02:47:19.195077 19967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.184874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53410 (local address 127.10.75.124:44807)
0812 02:47:19.184968 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.184972 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.184984 (+ 12us) server_negotiation.cc:407] Connection header received
0812 02:47:19.185016 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.185018 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.185054 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.185135 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.185557 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.186305 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.187274 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.187602 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.187697 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:19.190079 (+ 2382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:19.190083 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:19.190086 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:19.190123 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:19.191862 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.193476 (+ 1614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.193484 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.193490 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.193573 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.194052 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.194110 (+ 58us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.194112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.194352 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:19.194435 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:19.194776 (+ 341us) server_negotiation.cc:299] Negotiation successful
0812 02:47:19.194889 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 02:47:19.195508 19966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.184742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:44807 (local address 127.0.0.1:53410)
0812 02:47:19.184836 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:19.184851 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:47:19.184926 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:47:19.185188 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:47:19.185191 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:47:19.185341 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:47:19.185424 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:19.185429 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.186425 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.186428 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:19.187146 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:19.187158 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.187793 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.187796 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:19.187878 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:19.188394 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:47:19.188408 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:47:19.189915 (+ 1507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:47:19.193085 (+ 3170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:19.193088 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:19.193090 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:19.193362 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:19.193821 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:19.193828 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:19.193833 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:19.193940 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:19.194496 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:47:19.194500 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:47:19.194585 (+ 85us) client_negotiation.cc:769] Sending connection context
0812 02:47:19.195205 (+ 620us) client_negotiation.cc:240] Negotiation successful
0812 02:47:19.195333 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 02:47:19.197124 19822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.183805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48228 (local address 127.10.75.125:44907)
0812 02:47:19.183932 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.183936 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.186325 (+ 2389us) server_negotiation.cc:407] Connection header received
0812 02:47:19.186498 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.186501 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.186543 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.186590 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.187439 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.188453 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.189559 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.189903 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.189980 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:19.193074 (+ 3094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:19.193078 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:19.193081 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:19.193107 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:19.194866 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.195449 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.195453 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.195455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.195545 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.196307 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.196312 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.196314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.196489 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:19.196699 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:19.196865 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 02:47:19.196976 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 02:47:19.197605 19676 raft_consensus.cc:348] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852ad8142d164ff58464d449fa079b81" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } } peers { permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } } peers { permanent_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } }
I20260812 02:47:19.197852 19676 raft_consensus.cc:729] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 852ad8142d164ff58464d449fa079b81, State: Initialized, Role: FOLLOWER
I20260812 02:47:19.198194 19676 consensus_queue.cc:260] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852ad8142d164ff58464d449fa079b81" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } } peers { permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } } peers { permanent_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } }
I20260812 02:47:19.198536 19956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680: Bootstrap starting.
I20260812 02:47:19.198905 19975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852ad8142d164ff58464d449fa079b81" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } } peers { permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } } peers { permanent_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } } }
I20260812 02:47:19.199225 19975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:47:19.199589 19676 sys_catalog.cc:564] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:47:19.200748 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:47:19.201152 19956 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680: Neither blocks nor log segments found. Creating new log.
I20260812 02:47:19.202080 19632 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "852ad8142d164ff58464d449fa079b81"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59264
I20260812 02:47:19.202404 19632 raft_consensus.cc:482] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 02:47:19.202515 19632 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:47:19.202953 19956 log.cc:824] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680: Log is configured to *not* fsync() on all Append() calls
I20260812 02:47:19.203778 19632 raft_consensus.cc:504] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852ad8142d164ff58464d449fa079b81" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } } peers { permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } } peers { permanent_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } }
I20260812 02:47:19.204541 19813 raft_consensus.cc:348] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852ad8142d164ff58464d449fa079b81" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } } peers { permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } } peers { permanent_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } }
I20260812 02:47:19.204743 19632 leader_election.cc:288] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [CANDIDATE]: Term 1 election: Requested vote from peers ebb45d8882d3489ba874e39ca7a8116d (127.10.75.125:44907), c1f91ad3f3bf4d0e829e0bec04d5a680 (127.10.75.124:44807)
I20260812 02:47:19.205189 19956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680: No bootstrap required, opened a new log
W20260812 02:47:19.205981 20002 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:47:19.206156 20002 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:47:19.209378 19956 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852ad8142d164ff58464d449fa079b81" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } } peers { permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } } peers { permanent_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } }
I20260812 02:47:19.209606 19956 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f91ad3f3bf4d0e829e0bec04d5a680, State: Initialized, Role: FOLLOWER
I20260812 02:47:19.209935 19956 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852ad8142d164ff58464d449fa079b81" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } } peers { permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } } peers { permanent_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } }
I20260812 02:47:19.211256 19956 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:47:19.208555 19555 master_runner.cc:186] Error getting master registration for 127.10.75.125:44907: OK, instance_id { permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" instance_seqno: 1786502838911183 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 02:47:19.212218 19901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "852ad8142d164ff58464d449fa079b81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680"
I20260812 02:47:19.212488 19901 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680 [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:47:19.213354 19555 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 02:47:19.213519 19813 raft_consensus.cc:729] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebb45d8882d3489ba874e39ca7a8116d, State: Initialized, Role: FOLLOWER
I20260812 02:47:19.213930 19813 consensus_queue.cc:260] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852ad8142d164ff58464d449fa079b81" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } } peers { permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } } peers { permanent_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } }
I20260812 02:47:19.216526 19901 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 852ad8142d164ff58464d449fa079b81 in term 1.
I20260812 02:47:19.217060 19584 leader_election.cc:302] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 852ad8142d164ff58464d449fa079b81, c1f91ad3f3bf4d0e829e0bec04d5a680; no voters:
I20260812 02:47:19.217526 19679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.207086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59268 (local address 127.10.75.126:41759)
0812 02:47:19.207409 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.207414 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.207543 (+ 129us) server_negotiation.cc:407] Connection header received
0812 02:47:19.207737 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.207742 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.207790 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.207848 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.208915 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.209704 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.211105 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.211460 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.211537 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:19.213469 (+ 1932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:19.213476 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:19.213479 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:19.213515 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:19.215320 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.215865 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.215871 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.215874 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.215965 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.216369 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.216374 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.216377 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.216622 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:19.216761 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:19.217208 (+ 447us) server_negotiation.cc:299] Negotiation successful
0812 02:47:19.217345 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247}
I20260812 02:47:19.217684 19975 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:47:19.217748 19813 sys_catalog.cc:564] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:47:19.217932 19975 raft_consensus.cc:686] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [term 1 LEADER]: Becoming Leader. State: Replica: 852ad8142d164ff58464d449fa079b81, State: Running, Role: LEADER
I20260812 02:47:19.218236 19767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "852ad8142d164ff58464d449fa079b81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ebb45d8882d3489ba874e39ca7a8116d"
I20260812 02:47:19.218350 19975 consensus_queue.cc:237] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852ad8142d164ff58464d449fa079b81" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } } peers { permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } } peers { permanent_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } }
I20260812 02:47:19.218467 19767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:47:19.219975 19767 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 852ad8142d164ff58464d449fa079b81 in term 1.
I20260812 02:47:19.221800 19975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 852ad8142d164ff58464d449fa079b81. Latest consensus state: current_term: 1 leader_uuid: "852ad8142d164ff58464d449fa079b81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852ad8142d164ff58464d449fa079b81" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } } peers { permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } } peers { permanent_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } } }
I20260812 02:47:19.221962 19975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:19.224190 20017 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852ad8142d164ff58464d449fa079b81" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } } peers { permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } } peers { permanent_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } } }
I20260812 02:47:19.224459 20017 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:47:19.226449 19967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.207124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53424 (local address 127.10.75.124:44807)
0812 02:47:19.207255 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.207260 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.207916 (+ 656us) server_negotiation.cc:407] Connection header received
0812 02:47:19.208216 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.208219 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.208275 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.208333 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.209809 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.210561 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.212187 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.212563 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.212666 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:19.215940 (+ 3274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:19.215945 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:19.215947 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:19.215972 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:19.217854 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.221937 (+ 4083us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.221940 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.221943 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.222039 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.222417 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.222421 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.222422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.222660 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:19.222771 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:19.226168 (+ 3397us) server_negotiation.cc:299] Negotiation successful
0812 02:47:19.226294 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 02:47:19.227227 20036 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852ad8142d164ff58464d449fa079b81" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } } peers { permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } } peers { permanent_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } } }
I20260812 02:47:19.227438 20036 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:47:19.227892 20071 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:47:19.229110 20071 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:47:19.233829 19822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:19.220275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48240 (local address 127.10.75.125:44907)
0812 02:47:19.220393 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.220398 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.224014 (+ 3616us) server_negotiation.cc:407] Connection header received
0812 02:47:19.224220 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.224223 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.224278 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.224334 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.225290 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.226016 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.227660 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:19.227982 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:19.228095 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:19.229942 (+ 1847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:19.229946 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:19.229949 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:19.229979 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:19.231783 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.232304 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.232309 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.232310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.232411 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:19.232770 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:19.232773 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:19.232775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:19.233007 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:19.233126 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:19.233537 (+ 411us) server_negotiation.cc:299] Negotiation successful
0812 02:47:19.233674 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 02:47:19.238921 19767 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d [term 1 FOLLOWER]: Refusing update from remote peer 852ad8142d164ff58464d449fa079b81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:47:19.238962 19901 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680 [term 1 FOLLOWER]: Refusing update from remote peer 852ad8142d164ff58464d449fa079b81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:47:19.239632 19975 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:47:19.239843 20043 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:47:19.244251 20017 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 852ad8142d164ff58464d449fa079b81. Latest consensus state: current_term: 1 leader_uuid: "852ad8142d164ff58464d449fa079b81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852ad8142d164ff58464d449fa079b81" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } } peers { permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } } peers { permanent_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } } }
I20260812 02:47:19.244448 20017 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:47:19.245556 20036 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 852ad8142d164ff58464d449fa079b81. Latest consensus state: current_term: 1 leader_uuid: "852ad8142d164ff58464d449fa079b81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852ad8142d164ff58464d449fa079b81" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } } peers { permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } } peers { permanent_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } } }
I20260812 02:47:19.245682 20036 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d [sys.catalog]: This master's current role is: FOLLOWER
W20260812 02:47:19.249074 20069 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:47:19.249169 20069 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:47:19.251695 20072 mvcc.cc:205] Tried to move back new op lower bound from 7317515629516156928 to 7317515629448278016. Current Snapshot: MvccSnapshot[applied={T|T < 7317515629516156928}]
W20260812 02:47:19.251945 20042 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:47:19.252032 20042 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:47:19.252627 19975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "852ad8142d164ff58464d449fa079b81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852ad8142d164ff58464d449fa079b81" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } } peers { permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } } peers { permanent_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } } }
I20260812 02:47:19.252755 19975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:19.253540 20017 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "852ad8142d164ff58464d449fa079b81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852ad8142d164ff58464d449fa079b81" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } } peers { permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } } peers { permanent_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } } }
I20260812 02:47:19.253666 20017 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:47:19.253827 19975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "852ad8142d164ff58464d449fa079b81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852ad8142d164ff58464d449fa079b81" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } } peers { permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } } peers { permanent_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } } }
I20260812 02:47:19.253942 19975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81 [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:19.255148 20036 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "852ad8142d164ff58464d449fa079b81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "852ad8142d164ff58464d449fa079b81" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 41759 } } peers { permanent_uuid: "ebb45d8882d3489ba874e39ca7a8116d" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 44907 } } peers { permanent_uuid: "c1f91ad3f3bf4d0e829e0bec04d5a680" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 44807 } } }
I20260812 02:47:19.255280 20036 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:47:19.255641 20078 mvcc.cc:205] Tried to move back new op lower bound from 7317515629516156928 to 7317515629448278016. Current Snapshot: MvccSnapshot[applied={T|T < 7317515629516156928}]
I20260812 02:47:19.256088 20071 catalog_manager.cc:1347] Generated new cluster ID: 7f9b140dd6c244058d7f1f59d7093717
I20260812 02:47:19.256162 20071 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:47:19.281657 20071 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:47:19.283030 20071 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:47:19.293928 20071 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 852ad8142d164ff58464d449fa079b81: Generated new TSK 0
I20260812 02:47:19.294787 20071 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 02:47:19.328760 19679 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:19.325265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59278 (local address 127.10.75.126:41759)
0812 02:47:19.325402 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.325408 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.327450 (+ 2042us) server_negotiation.cc:407] Connection header received
0812 02:47:19.327656 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.327660 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.327713 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.327782 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.328599 (+ 817us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59278: BlockingRecv error: recv got EOF from 127.0.0.1:59278 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260812 02:47:19.330858 19967 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:19.326100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53434 (local address 127.10.75.124:44807)
0812 02:47:19.326219 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.326224 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.329201 (+ 2977us) server_negotiation.cc:407] Connection header received
0812 02:47:19.329798 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.329801 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.329852 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.329903 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.330740 (+ 837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53434: BlockingRecv error: recv got EOF from 127.0.0.1:53434 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260812 02:47:19.331629 19822 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:19.326838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48254 (local address 127.10.75.125:44907)
0812 02:47:19.326954 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.326959 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.329519 (+ 2560us) server_negotiation.cc:407] Connection header received
0812 02:47:19.330032 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.330035 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.330126 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.330179 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.331508 (+ 1329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48254: BlockingRecv error: recv got EOF from 127.0.0.1:48254 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260812 02:47:19.336483 19822 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:19.334957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48262 (local address 127.10.75.125:44907)
0812 02:47:19.335061 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.335065 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.335518 (+ 453us) server_negotiation.cc:407] Connection header received
0812 02:47:19.335743 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.335746 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.335823 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.335876 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.336383 (+ 507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48262: BlockingRecv error: recv got EOF from 127.0.0.1:48262 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260812 02:47:19.342401 19822 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:19.340789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48274 (local address 127.10.75.125:44907)
0812 02:47:19.340896 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.340901 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.341436 (+ 535us) server_negotiation.cc:407] Connection header received
0812 02:47:19.341623 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.341626 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.341672 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.341720 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.342300 (+ 580us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48274: BlockingRecv error: recv got EOF from 127.0.0.1:48274 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260812 02:47:19.348096 19822 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:19.346599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48276 (local address 127.10.75.125:44907)
0812 02:47:19.346697 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.346701 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.347190 (+ 489us) server_negotiation.cc:407] Connection header received
0812 02:47:19.347375 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.347379 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.347430 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.347479 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.347980 (+ 501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48276: BlockingRecv error: recv got EOF from 127.0.0.1:48276 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260812 02:47:19.355923 19822 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:19.354310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48280 (local address 127.10.75.125:44907)
0812 02:47:19.354454 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.354458 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.354967 (+ 509us) server_negotiation.cc:407] Connection header received
0812 02:47:19.355184 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.355187 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.355240 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.355292 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.355816 (+ 524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48280: BlockingRecv error: recv got EOF from 127.0.0.1:48280 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260812 02:47:19.368229 19822 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:19.366495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48296 (local address 127.10.75.125:44907)
0812 02:47:19.366623 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.366628 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.367220 (+ 592us) server_negotiation.cc:407] Connection header received
0812 02:47:19.367426 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.367430 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.367483 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.367537 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.368111 (+ 574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48296: BlockingRecv error: recv got EOF from 127.0.0.1:48296 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260812 02:47:19.388947 19822 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:19.386987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48310 (local address 127.10.75.125:44907)
0812 02:47:19.387137 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.387143 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.387738 (+ 595us) server_negotiation.cc:407] Connection header received
0812 02:47:19.387964 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.387968 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.388028 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.388121 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.388827 (+ 706us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48310: BlockingRecv error: recv got EOF from 127.0.0.1:48310 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260812 02:47:19.425561 19822 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:19.423799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48316 (local address 127.10.75.125:44907)
0812 02:47:19.423926 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.423931 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.424540 (+ 609us) server_negotiation.cc:407] Connection header received
0812 02:47:19.424765 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.424769 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.424824 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.424875 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.425440 (+ 565us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48316: BlockingRecv error: recv got EOF from 127.0.0.1:48316 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260812 02:47:19.493482 19822 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:19.492301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48320 (local address 127.10.75.125:44907)
0812 02:47:19.492445 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.492449 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.492702 (+ 253us) server_negotiation.cc:407] Connection header received
0812 02:47:19.492824 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.492827 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.492880 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.492955 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.493381 (+ 426us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48320: BlockingRecv error: recv got EOF from 127.0.0.1:48320 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260812 02:47:19.625779 19822 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:19.624488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48336 (local address 127.10.75.125:44907)
0812 02:47:19.624695 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.624700 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.624811 (+ 111us) server_negotiation.cc:407] Connection header received
0812 02:47:19.624981 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.624984 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.625046 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.625140 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.625647 (+ 507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48336: BlockingRecv error: recv got EOF from 127.0.0.1:48336 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
W20260812 02:47:19.886399 19822 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:19.885014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48338 (local address 127.10.75.125:44907)
0812 02:47:19.885183 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:19.885188 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:19.885308 (+ 120us) server_negotiation.cc:407] Connection header received
0812 02:47:19.885462 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:19.885464 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:19.885524 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:19.885616 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:19.886256 (+ 640us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48338: BlockingRecv error: recv got EOF from 127.0.0.1:48338 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 02:47:20.251150 20069 catalog_manager.cc:1259] Loaded cluster ID: 7f9b140dd6c244058d7f1f59d7093717
I20260812 02:47:20.251300 20069 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d: loading cluster ID for follower catalog manager: success
I20260812 02:47:20.253610 20042 catalog_manager.cc:1259] Loaded cluster ID: 7f9b140dd6c244058d7f1f59d7093717
I20260812 02:47:20.253729 20042 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680: loading cluster ID for follower catalog manager: success
I20260812 02:47:20.254134 20069 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d: acquiring CA information for follower catalog manager: success
I20260812 02:47:20.255877 20069 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ebb45d8882d3489ba874e39ca7a8116d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 02:47:20.256194 20042 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680: acquiring CA information for follower catalog manager: success
I20260812 02:47:20.257344 20042 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c1f91ad3f3bf4d0e829e0bec04d5a680: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 02:47:20.406654 20225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:20.401722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48352 (local address 127.10.75.125:44907)
0812 02:47:20.402132 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:20.402136 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:20.402187 (+ 51us) server_negotiation.cc:407] Connection header received
0812 02:47:20.402401 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:20.402404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:20.402590 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:20.402729 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:47:20.403046 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:20.403686 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:20.404642 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:20.404931 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:20.405039 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:20.405408 (+ 369us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:47:20.406058 (+ 650us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:47:20.406226 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:20.406290 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 02:47:20.406367 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":118,"threads_started":1}
I20260812 02:47:20.416556 20237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:20.411257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53448 (local address 127.10.75.124:44807)
0812 02:47:20.411575 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:20.411581 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:20.411694 (+ 113us) server_negotiation.cc:407] Connection header received
0812 02:47:20.412075 (+ 381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:20.412080 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:20.412267 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:20.412431 (+ 164us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:47:20.412705 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:20.413387 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:20.414502 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:20.414759 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:20.414887 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:20.415277 (+ 390us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:47:20.416043 (+ 766us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:47:20.416223 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:20.416260 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 02:47:20.416343 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":93,"threads_started":1}
I20260812 02:47:20.425230 20225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:20.421223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48364 (local address 127.10.75.125:44907)
0812 02:47:20.421420 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:20.421424 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:20.421437 (+ 13us) server_negotiation.cc:407] Connection header received
0812 02:47:20.421494 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:20.421496 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:20.421615 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:20.421722 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:47:20.422247 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:20.422887 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:20.423880 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:20.424136 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:20.424267 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:20.424592 (+ 325us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:47:20.424693 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:47:20.424751 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:20.424942 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 02:47:20.425041 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 02:47:20.426304 20247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:20.420623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59284 (local address 127.10.75.126:41759)
0812 02:47:20.420954 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:20.420959 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:20.421073 (+ 114us) server_negotiation.cc:407] Connection header received
0812 02:47:20.421475 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:20.421481 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:20.421766 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:20.421928 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:47:20.422387 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:20.423233 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:20.424398 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:20.424764 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:20.424890 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:20.425238 (+ 348us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:47:20.425746 (+ 508us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:47:20.425870 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:20.425983 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 02:47:20.426106 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":106,"threads_started":1}
I20260812 02:47:20.426437 20237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:20.421008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53456 (local address 127.10.75.124:44807)
0812 02:47:20.421162 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:20.421167 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:20.421606 (+ 439us) server_negotiation.cc:407] Connection header received
0812 02:47:20.421730 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:20.421734 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:20.421790 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:20.421869 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:47:20.422263 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:20.423122 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:20.424998 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:20.425345 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:20.425456 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:20.425845 (+ 389us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:47:20.425956 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:47:20.426028 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:20.426208 (+ 180us) server_negotiation.cc:299] Negotiation successful
0812 02:47:20.426279 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 02:47:20.430547 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 19555
I20260812 02:47:20.457983 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 19688
I20260812 02:47:20.482682 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 19826
2026-08-12T02:47:20Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3428 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 02:47:20 dist-test-slave-2p8l krb5kdc[20254](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 02:47:20 dist-test-slave-2p8l krb5kdc[20254](info): set up 2 sockets
Aug 12 02:47:20 dist-test-slave-2p8l krb5kdc[20254](info): commencing operation
krb5kdc: starting...
W20260812 02:47:21.841014 10541 mini_kdc.cc:121] Time spent starting KDC: real 1.315s user 0.005s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/test-user.keytab.
Aug 12 02:47:21 dist-test-slave-2p8l krb5kdc[20254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T02:47:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T02:47:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.75.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
Entry for principal kudu/127.10.75.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab.
I20260812 02:47:21.973184 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:36347
--webserver_interface=127.10.75.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:35521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:36347,127.10.75.125:45853,127.10.75.124:37629
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 02:47:22.088017 20277 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 02:47:22.088280 20277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:47:22.088335 20277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:47:22.088423 20277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 02:47:22.092334 20277 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:47:22.092381 20277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:47:22.092401 20277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:47:22.092454 20277 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:47:22.092494 20277 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:47:22.097687 20277 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:35521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:36347,127.10.75.125:45853,127.10.75.124:37629
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.126.keytab
--principal=kudu/127.10.75.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.126:36347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.75.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:47:22.098716 20277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:47:22.099743 20277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:47:22.108217 20293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:22.108286 20277 server_base.cc:1034] running on GCE node
W20260812 02:47:22.108376 20289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:22.108584 20296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:22.109197 20277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:47:22.110352 20277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:47:22.111527 20277 hybrid_clock.cc:648] HybridClock initialized: now 1786502842111503 us; error 46 us; skew 500 ppm
Aug 12 02:47:22 dist-test-slave-2p8l krb5kdc[20254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502842, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:47:22.114401 20277 init.cc:377] Logged in from keytab as kudu/127.10.75.126@KRBTEST.COM (short username kudu)
I20260812 02:47:22.115265 20277 webserver.cc:460] Webserver started at http://127.10.75.126:41217/ using document root <none> and password file <none>
I20260812 02:47:22.115805 20277 fs_manager.cc:359] Metadata directory not provided
I20260812 02:47:22.115866 20277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:47:22.116127 20277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:47:22.118152 20277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-0/data/instance:
uuid: "eef338bd7ad24c78aebabd15f942f48f"
format_stamp: "Formatted at 2026-08-12 02:47:22 on dist-test-slave-2p8l"
server_key: "fbf29e78ac734d0bbddd0008bb5ff50f"
server_key_iv: "5dc3e7171d50c3bb30f48d80fec10095"
server_key_version: "encryptionkey@0"
I20260812 02:47:22.118741 20277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-0/wal/instance:
uuid: "eef338bd7ad24c78aebabd15f942f48f"
format_stamp: "Formatted at 2026-08-12 02:47:22 on dist-test-slave-2p8l"
server_key: "fbf29e78ac734d0bbddd0008bb5ff50f"
server_key_iv: "5dc3e7171d50c3bb30f48d80fec10095"
server_key_version: "encryptionkey@0"
I20260812 02:47:22.122464 20277 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260812 02:47:22.124915 20305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:47:22.126219 20277 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 02:47:22.126348 20277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-0/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-0/wal
uuid: "eef338bd7ad24c78aebabd15f942f48f"
format_stamp: "Formatted at 2026-08-12 02:47:22 on dist-test-slave-2p8l"
server_key: "fbf29e78ac734d0bbddd0008bb5ff50f"
server_key_iv: "5dc3e7171d50c3bb30f48d80fec10095"
server_key_version: "encryptionkey@0"
I20260812 02:47:22.126452 20277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:47:22.146338 20277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:47:22.149255 20277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:47:22.149442 20277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:47:22.156677 20277 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.126:36347
I20260812 02:47:22.156986 20404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.126:36347 every 8 connection(s)
I20260812 02:47:22.157758 20277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-0/data/info.pb
I20260812 02:47:22.160887 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 20277
I20260812 02:47:22.161034 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-0/wal/instance
I20260812 02:47:22.161034 20406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:47:22.161371 10541 external_mini_cluster.cc:1428] Setting key d1d8b4528659672197f72a229175df25
I20260812 02:47:22.165599 20406 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.10.75.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.125@KRBTEST.COM" created.
Aug 12 02:47:22 dist-test-slave-2p8l krb5kdc[20254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502842, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:47:22.182595 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.168021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:36347 (local address 127.0.0.1:44452)
0812 02:47:22.168540 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.168594 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 02:47:22.169480 (+ 886us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:47:22.170407 (+ 927us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:47:22.170411 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:47:22.170850 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:47:22.171124 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:22.171138 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.172384 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.172387 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:22.173226 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:22.173237 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.174298 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.174304 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:22.174468 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.175223 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:47:22.175250 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:47:22.177337 (+ 2087us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:47:22.179490 (+ 2153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:22.179501 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:22.179512 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:22.179747 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:22.180084 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:22.180089 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:22.180092 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:22.180208 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:22.180814 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:47:22.180820 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:47:22.180961 (+ 141us) client_negotiation.cc:769] Sending connection context
0812 02:47:22.181137 (+ 176us) client_negotiation.cc:240] Negotiation successful
0812 02:47:22.181564 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"mutex_wait_us":117,"thread_start_us":141,"threads_started":1}
I20260812 02:47:22.182595 20411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.168022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44452 (local address 127.10.75.126:36347)
0812 02:47:22.168600 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.168620 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.168705 (+ 85us) server_negotiation.cc:407] Connection header received
0812 02:47:22.169834 (+ 1129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.169842 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.170171 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.170361 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.171283 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.172251 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.173370 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.174033 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.174238 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.177515 (+ 3277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:22.177522 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:22.177533 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:22.177554 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:22.179378 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.179864 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.179877 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.179879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.179980 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.180308 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.180312 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.180313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.180689 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:22.180830 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:22.181214 (+ 384us) server_negotiation.cc:299] Negotiation successful
0812 02:47:22.181520 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":449,"thread_start_us":176,"threads_started":1}
I20260812 02:47:22.185029 20406 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } has no permanent_uuid. Determining permanent_uuid...
I20260812 02:47:22.185845 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.185544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:45853 (local address 127.0.0.1:39068)
0812 02:47:22.185691 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.185760 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.125:45853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260812 02:47:22.186115 20307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.75.125:45853: connect: Connection refused (error 111)
I20260812 02:47:22.186956 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.186750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:45853 (local address 127.0.0.1:39072)
0812 02:47:22.186855 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.186906 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.125:45853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 02:47:22.187150 20406 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.125:45853: Network error: Client connection negotiation failed: client connection to 127.10.75.125:45853: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.125.keytab.
Entry for principal kudu/127.10.75.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.125.keytab.
I20260812 02:47:22.191376 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.125:45853
--webserver_interface=127.10.75.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.125.keytab
--principal=kudu/127.10.75.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:35521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:36347,127.10.75.125:45853,127.10.75.124:37629
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:47:22.236415 20406 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } attempt: 1
I20260812 02:47:22.237387 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.236978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:45853 (local address 127.0.0.1:39080)
0812 02:47:22.237239 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.237308 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.125:45853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167}
I20260812 02:47:22.238221 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.237959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:45853 (local address 127.0.0.1:39094)
0812 02:47:22.238111 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.238166 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.125:45853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 02:47:22.238451 20406 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.125:45853: Network error: Client connection negotiation failed: client connection to 127.10.75.125:45853: connect: Connection refused (error 111)
W20260812 02:47:22.303817 20414 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 02:47:22.304139 20414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:47:22.304178 20414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:47:22.304253 20414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 02:47:22.306630 20406 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } attempt: 2
I20260812 02:47:22.307544 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.307183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:45853 (local address 127.0.0.1:39102)
0812 02:47:22.307399 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.307470 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.125:45853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260812 02:47:22.308312 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.308097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:45853 (local address 127.0.0.1:39116)
0812 02:47:22.308209 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.308259 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.125:45853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 02:47:22.308440 20406 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.125:45853: Network error: Client connection negotiation failed: client connection to 127.10.75.125:45853: connect: Connection refused (error 111)
W20260812 02:47:22.308753 20414 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:47:22.308825 20414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:47:22.308888 20414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:47:22.308943 20414 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:47:22.308980 20414 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:47:22.314189 20414 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:35521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:36347,127.10.75.125:45853,127.10.75.124:37629
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.125.keytab
--principal=kudu/127.10.75.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.125:45853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.75.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:47:22.315179 20414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:47:22.316166 20414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:47:22.325043 20421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:22.325086 20422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:22.327620 20414 server_base.cc:1034] running on GCE node
W20260812 02:47:22.325045 20425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:22.328243 20414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:47:22.329393 20414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:47:22.330605 20414 hybrid_clock.cc:648] HybridClock initialized: now 1786502842330584 us; error 55 us; skew 500 ppm
Aug 12 02:47:22 dist-test-slave-2p8l krb5kdc[20254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502842, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:47:22.333644 20414 init.cc:377] Logged in from keytab as kudu/127.10.75.125@KRBTEST.COM (short username kudu)
I20260812 02:47:22.334600 20414 webserver.cc:460] Webserver started at http://127.10.75.125:37857/ using document root <none> and password file <none>
I20260812 02:47:22.335167 20414 fs_manager.cc:359] Metadata directory not provided
I20260812 02:47:22.335259 20414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:47:22.335489 20414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:47:22.337491 20414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-1/data/instance:
uuid: "93f1b0eaa5b2471398af50fd531e703b"
format_stamp: "Formatted at 2026-08-12 02:47:22 on dist-test-slave-2p8l"
server_key: "c40a2eeb34be14ce446e6f0749b83086"
server_key_iv: "b56093d7b8eff4fc0bc155f274b1b337"
server_key_version: "encryptionkey@0"
I20260812 02:47:22.338105 20414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-1/wal/instance:
uuid: "93f1b0eaa5b2471398af50fd531e703b"
format_stamp: "Formatted at 2026-08-12 02:47:22 on dist-test-slave-2p8l"
server_key: "c40a2eeb34be14ce446e6f0749b83086"
server_key_iv: "b56093d7b8eff4fc0bc155f274b1b337"
server_key_version: "encryptionkey@0"
I20260812 02:47:22.341745 20414 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 02:47:22.344338 20435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:47:22.345590 20414 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:47:22.345736 20414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-1/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-1/wal
uuid: "93f1b0eaa5b2471398af50fd531e703b"
format_stamp: "Formatted at 2026-08-12 02:47:22 on dist-test-slave-2p8l"
server_key: "c40a2eeb34be14ce446e6f0749b83086"
server_key_iv: "b56093d7b8eff4fc0bc155f274b1b337"
server_key_version: "encryptionkey@0"
I20260812 02:47:22.345850 20414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:47:22.364741 20414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:47:22.367914 20414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:47:22.368129 20414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:47:22.375794 20414 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.125:45853
I20260812 02:47:22.376104 20534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.125:45853 every 8 connection(s)
I20260812 02:47:22.376801 20414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-1/data/info.pb
I20260812 02:47:22.378782 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 20414
I20260812 02:47:22.378952 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-1/wal/instance
I20260812 02:47:22.379292 10541 external_mini_cluster.cc:1428] Setting key ee2004c11e943ee46e44452d63921aac
I20260812 02:47:22.379828 20535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 02:47:22.383670 20535 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.10.75.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.75.124@KRBTEST.COM" created.
Aug 12 02:47:22 dist-test-slave-2p8l krb5kdc[20254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502842, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.125@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:47:22.398974 20411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.385728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44454 (local address 127.10.75.126:36347)
0812 02:47:22.385872 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.385876 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.387084 (+ 1208us) server_negotiation.cc:407] Connection header received
0812 02:47:22.388059 (+ 975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.388063 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.388126 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.388240 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.389456 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.390107 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.391439 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.391791 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.391910 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.394724 (+ 2814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:22.394731 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:22.394734 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:22.394769 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:22.396407 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.397137 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.397140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.397142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.397219 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.397671 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.397673 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.397674 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.397850 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:22.397929 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:22.398740 (+ 811us) server_negotiation.cc:299] Negotiation successful
0812 02:47:22.398850 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 02:47:22.399598 20406 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } attempt: 3
I20260812 02:47:22.400285 20539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.386354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:36347 (local address 127.0.0.1:44454)
0812 02:47:22.386925 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.386967 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 02:47:22.387824 (+ 857us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:47:22.388420 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:47:22.388427 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:47:22.388785 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:47:22.389299 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:22.389315 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.390256 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.390267 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:22.391309 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:22.391320 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.391953 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.391958 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:22.392137 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.392782 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:47:22.392799 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:47:22.394463 (+ 1664us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:47:22.396556 (+ 2093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:22.396566 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:22.396585 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:22.397019 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:22.397322 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:22.397326 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:22.397328 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:22.397556 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:22.397974 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:47:22.397984 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:47:22.398407 (+ 423us) client_negotiation.cc:769] Sending connection context
0812 02:47:22.398696 (+ 289us) client_negotiation.cc:240] Negotiation successful
0812 02:47:22.399111 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":177,"threads_started":1}
I20260812 02:47:22.402128 20535 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 02:47:22 dist-test-slave-2p8l krb5kdc[20254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502842, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for kudu/127.10.75.125@KRBTEST.COM
Aug 12 02:47:22 dist-test-slave-2p8l krb5kdc[20254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502842, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.125@KRBTEST.COM for kudu/127.10.75.125@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.75.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.124.keytab.
Entry for principal kudu/127.10.75.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.124.keytab.
I20260812 02:47:22.413033 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.400043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:45853 (local address 127.0.0.1:39120)
0812 02:47:22.400248 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.400263 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:47:22.400349 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:47:22.401000 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:47:22.401003 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:47:22.401189 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:47:22.401325 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:22.401331 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.402827 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.402833 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:22.404240 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:22.404250 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.405032 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.405037 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:22.405156 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.405736 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:47:22.405751 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:47:22.408203 (+ 2452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:47:22.411111 (+ 2908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:22.411114 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:22.411116 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:22.411398 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:22.411784 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:22.411787 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:22.411788 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:22.411900 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:22.412442 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:47:22.412445 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:47:22.412554 (+ 109us) client_negotiation.cc:769] Sending connection context
0812 02:47:22.412704 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 02:47:22.412854 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137}
I20260812 02:47:22.413131 20543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.400152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39120 (local address 127.10.75.125:45853)
0812 02:47:22.400574 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.400584 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.400607 (+ 23us) server_negotiation.cc:407] Connection header received
0812 02:47:22.400655 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.400659 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.400840 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.401495 (+ 655us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.401602 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.402646 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.404355 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.404878 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.404997 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.408361 (+ 3364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:22.408375 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:22.408391 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:22.408429 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:22.410958 (+ 2529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.411540 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.411548 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.411549 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.411676 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.412017 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.412021 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.412022 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.412332 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:22.412479 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:22.412805 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 02:47:22.412948 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"spinlock_wait_cycles":20224,"thread_start_us":156,"threads_started":1}
I20260812 02:47:22.413319 10541 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
/tmp/dist-test-taskWpp1yo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.124:37629
--webserver_interface=127.10.75.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.124.keytab
--principal=kudu/127.10.75.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.75.84:35521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.75.126:36347,127.10.75.125:45853,127.10.75.124:37629
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 02:47:22.413492 20539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.402690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:45853 (local address 127.0.0.1:39128)
0812 02:47:22.403218 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.403233 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 02:47:22.403342 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:47:22.403589 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:47:22.403592 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:47:22.403764 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:47:22.403874 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:22.403881 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.404775 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.404777 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:22.405682 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:22.405696 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.406322 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.406326 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:22.406458 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.406936 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:47:22.406949 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:47:22.408203 (+ 1254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:47:22.411264 (+ 3061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:22.411268 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:22.411270 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:22.411590 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:22.411944 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:22.411950 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:22.411954 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:22.412051 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:22.412675 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:47:22.412678 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:47:22.412786 (+ 108us) client_negotiation.cc:769] Sending connection context
0812 02:47:22.412892 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 02:47:22.413056 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"mutex_wait_us":5,"spinlock_wait_cycles":4480}
I20260812 02:47:22.413689 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.402890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39128 (local address 127.10.75.125:45853)
0812 02:47:22.403226 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.403233 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.403303 (+ 70us) server_negotiation.cc:407] Connection header received
0812 02:47:22.403435 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.403437 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.403471 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.403543 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.403987 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.404645 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.405842 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.406194 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.406321 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.408375 (+ 2054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:22.408378 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:22.408391 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:22.408431 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:22.411163 (+ 2732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.411694 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.411701 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.411706 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.411798 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.412213 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.412220 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.412225 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.412518 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:22.412634 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:22.413230 (+ 596us) server_negotiation.cc:299] Negotiation successful
0812 02:47:22.413361 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":276,"spinlock_wait_cycles":9984,"thread_start_us":146,"threads_started":1}
I20260812 02:47:22.415781 20535 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } has no permanent_uuid. Determining permanent_uuid...
I20260812 02:47:22.415936 20406 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } has no permanent_uuid. Determining permanent_uuid...
I20260812 02:47:22.416672 20539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.416347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:37629 (local address 127.0.0.1:50944)
0812 02:47:22.416487 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.416578 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 02:47:22.416685 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.416421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:37629 (local address 127.0.0.1:50960)
0812 02:47:22.416580 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.416625 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260812 02:47:22.416999 20438 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
I20260812 02:47:22.417613 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.417279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:37629 (local address 127.0.0.1:50968)
0812 02:47:22.417485 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.417536 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145}
W20260812 02:47:22.417738 20406 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:37629: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
I20260812 02:47:22.418051 20539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.417729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:37629 (local address 127.0.0.1:50978)
0812 02:47:22.417905 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.417967 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260812 02:47:22.418283 20535 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:37629: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
I20260812 02:47:22.448902 20406 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } attempt: 1
I20260812 02:47:22.449822 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.449462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:37629 (local address 127.0.0.1:50992)
0812 02:47:22.449646 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.449723 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260812 02:47:22.450791 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.450543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:37629 (local address 127.0.0.1:51002)
0812 02:47:22.450660 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.450717 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260812 02:47:22.450964 20406 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:37629: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
I20260812 02:47:22.467527 20535 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } attempt: 1
I20260812 02:47:22.468343 20539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.468004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:37629 (local address 127.0.0.1:51008)
0812 02:47:22.468170 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.468250 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 02:47:22.469185 20539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.468976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:37629 (local address 127.0.0.1:51020)
0812 02:47:22.469078 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.469128 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 02:47:22.469408 20535 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:37629: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
I20260812 02:47:22.526136 20406 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } attempt: 2
I20260812 02:47:22.527058 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.526750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:37629 (local address 127.0.0.1:51024)
0812 02:47:22.526906 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.526967 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260812 02:47:22.527909 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.527667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:37629 (local address 127.0.0.1:51034)
0812 02:47:22.527804 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.527855 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260812 02:47:22.528082 20406 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:37629: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
W20260812 02:47:22.534725 20546 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 02:47:22.535032 20546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 02:47:22.535096 20546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 02:47:22.535173 20546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 02:47:22.537575 20535 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } attempt: 2
I20260812 02:47:22.538369 20539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.538104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:37629 (local address 127.0.0.1:51050)
0812 02:47:22.538245 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.538300 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 02:47:22.539083 20539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.538866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:37629 (local address 127.0.0.1:51060)
0812 02:47:22.538976 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.539029 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260812 02:47:22.539214 20535 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:37629: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
W20260812 02:47:22.539508 20546 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 02:47:22.539552 20546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 02:47:22.539592 20546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 02:47:22.539647 20546 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 02:47:22.539700 20546 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 02:47:22.544997 20546 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.75.84:35521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.75.126:36347,127.10.75.125:45853,127.10.75.124:37629
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/krb5kdc/kudu_127.10.75.124.keytab
--principal=kudu/127.10.75.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.75.124:37629
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.75.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20546
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 01:57:48 UTC on ccycloud.quasar-pvzurd.root.comops.site
build id 4581823
I20260812 02:47:22.545989 20546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 02:47:22.547039 20546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 02:47:22.555358 20572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:22.555438 20563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 02:47:22.555455 20566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 02:47:22.555620 20546 server_base.cc:1034] running on GCE node
I20260812 02:47:22.556151 20546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 02:47:22.557263 20546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 02:47:22.558465 20546 hybrid_clock.cc:648] HybridClock initialized: now 1786502842558444 us; error 34 us; skew 500 ppm
Aug 12 02:47:22 dist-test-slave-2p8l krb5kdc[20254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502842, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 02:47:22.561380 20546 init.cc:377] Logged in from keytab as kudu/127.10.75.124@KRBTEST.COM (short username kudu)
I20260812 02:47:22.562348 20546 webserver.cc:460] Webserver started at http://127.10.75.124:38541/ using document root <none> and password file <none>
I20260812 02:47:22.562908 20546 fs_manager.cc:359] Metadata directory not provided
I20260812 02:47:22.563011 20546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 02:47:22.563249 20546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 02:47:22.565276 20546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-2/data/instance:
uuid: "b5f759956f1f4b44bedc37809c4a490b"
format_stamp: "Formatted at 2026-08-12 02:47:22 on dist-test-slave-2p8l"
server_key: "84ef27fbd36a38cf46a6186a14a11bfa"
server_key_iv: "df7c36c2622f8a408223fdc1f21ad1a8"
server_key_version: "encryptionkey@0"
I20260812 02:47:22.565848 20546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-2/wal/instance:
uuid: "b5f759956f1f4b44bedc37809c4a490b"
format_stamp: "Formatted at 2026-08-12 02:47:22 on dist-test-slave-2p8l"
server_key: "84ef27fbd36a38cf46a6186a14a11bfa"
server_key_iv: "df7c36c2622f8a408223fdc1f21ad1a8"
server_key_version: "encryptionkey@0"
I20260812 02:47:22.569515 20546 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 02:47:22.571985 20585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 02:47:22.573206 20546 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 02:47:22.573370 20546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-2/data,/tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-2/wal
uuid: "b5f759956f1f4b44bedc37809c4a490b"
format_stamp: "Formatted at 2026-08-12 02:47:22 on dist-test-slave-2p8l"
server_key: "84ef27fbd36a38cf46a6186a14a11bfa"
server_key_iv: "df7c36c2622f8a408223fdc1f21ad1a8"
server_key_version: "encryptionkey@0"
I20260812 02:47:22.573491 20546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 02:47:22.618984 20546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 02:47:22.622370 20546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 02:47:22.622586 20546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 02:47:22.627251 20406 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } attempt: 3
I20260812 02:47:22.628120 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.627843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:37629 (local address 127.0.0.1:51068)
0812 02:47:22.627964 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.628028 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 02:47:22.628882 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.628658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:37629 (local address 127.0.0.1:51072)
0812 02:47:22.628774 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.628822 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 02:47:22.629065 20406 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.75.124:37629: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
I20260812 02:47:22.630369 20535 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } attempt: 3
I20260812 02:47:22.630951 20546 rpc_server.cc:307] RPC server started. Bound to: 127.10.75.124:37629
I20260812 02:47:22.631068 20539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.630786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:37629 (local address 127.0.0.1:51076)
0812 02:47:22.630930 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.630990 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.75.124:37629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260812 02:47:22.631274 20669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.75.124:37629 every 8 connection(s)
I20260812 02:47:22.632251 20546 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-2/data/info.pb
I20260812 02:47:22.635167 20670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 02:47:22 dist-test-slave-2p8l krb5kdc[20254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502842, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.125@KRBTEST.COM for kudu/127.10.75.124@KRBTEST.COM
I20260812 02:47:22.638859 20670 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } has no permanent_uuid. Determining permanent_uuid...
I20260812 02:47:22.642551 10541 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu as pid 20546
I20260812 02:47:22.642699 10541 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWpp1yo/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786502539688512-10541-0/minicluster-data/master-2/wal/instance
I20260812 02:47:22.643020 10541 external_mini_cluster.cc:1428] Setting key aec50dd1f94012e56c8c32403e8b31d0
I20260812 02:47:22.643714 20539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.631647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:37629 (local address 127.0.0.1:51078)
0812 02:47:22.631792 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.631806 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:47:22.631901 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:47:22.634420 (+ 2519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:47:22.634423 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:47:22.634635 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:47:22.634749 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:22.634757 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.636105 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.636111 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:22.636660 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:22.636670 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.637403 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.637406 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:22.637491 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.638024 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:47:22.638046 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:47:22.639346 (+ 1300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:47:22.641684 (+ 2338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:22.641688 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:22.641691 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:22.641896 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:22.642359 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:22.642364 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:22.642366 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:22.642478 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:22.643230 (+ 752us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:47:22.643233 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:47:22.643331 (+ 98us) client_negotiation.cc:769] Sending connection context
0812 02:47:22.643417 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 02:47:22.643554 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260812 02:47:22.645323 20671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.632422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51078 (local address 127.10.75.124:37629)
0812 02:47:22.633004 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.633026 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.633061 (+ 35us) server_negotiation.cc:407] Connection header received
0812 02:47:22.633705 (+ 644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.633720 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.634047 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.634483 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.634901 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.635972 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.636788 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.637268 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.637436 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.639563 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:22.639568 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:22.639580 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:22.639607 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:22.641562 (+ 1955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.642015 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.642026 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.642030 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.642242 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.642600 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.642603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.642605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.643094 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:22.643922 (+ 828us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:22.644072 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 02:47:22.644371 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":181,"threads_started":1}
Aug 12 02:47:22 dist-test-slave-2p8l krb5kdc[20254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502842, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.124@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:47:22.650238 20535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b: Bootstrap starting.
I20260812 02:47:22.651207 20411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.640713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44456 (local address 127.10.75.126:36347)
0812 02:47:22.640868 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.640872 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.641205 (+ 333us) server_negotiation.cc:407] Connection header received
0812 02:47:22.641374 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.641377 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.641430 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.641520 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.642229 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.642914 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.644325 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.644667 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.644747 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.647293 (+ 2546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:22.647297 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:22.647302 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:22.647337 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:22.649122 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.649677 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.649683 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.649688 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.649792 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.650166 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.650172 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.650177 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.650423 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:22.650530 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:22.650926 (+ 396us) server_negotiation.cc:299] Negotiation successful
0812 02:47:22.651082 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 02:47:22.651213 20674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.640665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.126:36347 (local address 127.0.0.1:44456)
0812 02:47:22.641079 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.641119 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 02:47:22.641270 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:47:22.641565 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:47:22.641570 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:47:22.641891 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:47:22.642013 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:22.642020 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.643119 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.643122 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:22.644184 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:22.644194 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.644897 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.644900 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:22.645012 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.645577 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:47:22.645591 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:47:22.647131 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:47:22.649246 (+ 2115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:22.649256 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:22.649262 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:22.649564 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:22.649900 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:22.649904 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:22.649905 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:22.650039 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:22.650545 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:47:22.650551 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:47:22.650672 (+ 121us) client_negotiation.cc:769] Sending connection context
0812 02:47:22.650817 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 02:47:22.651025 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":151,"threads_started":1}
Aug 12 02:47:22 dist-test-slave-2p8l krb5kdc[20254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.124@KRBTEST.COM
I20260812 02:47:22.652818 20670 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } has no permanent_uuid. Determining permanent_uuid...
I20260812 02:47:22.653121 20535 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b: Neither blocks nor log segments found. Creating new log.
I20260812 02:47:22.654311 20535 log.cc:824] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b: Log is configured to *not* fsync() on all Append() calls
I20260812 02:47:22.656383 20535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b: No bootstrap required, opened a new log
I20260812 02:47:22.658198 20677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.643890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51088 (local address 127.10.75.124:37629)
0812 02:47:22.644472 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.644481 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.646521 (+ 2040us) server_negotiation.cc:407] Connection header received
0812 02:47:22.646687 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.646691 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.646739 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.646823 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.647837 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.648548 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.649749 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.650143 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.650242 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.653916 (+ 3674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:22.653930 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:22.653932 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:22.653952 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:22.656310 (+ 2358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.656827 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.656831 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.656833 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.656917 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.657203 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.657207 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.657209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.657395 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:22.657574 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:22.657799 (+ 225us) server_negotiation.cc:299] Negotiation successful
0812 02:47:22.657949 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"spinlock_wait_cycles":3456,"thread_start_us":97,"threads_started":1}
Aug 12 02:47:22 dist-test-slave-2p8l krb5kdc[20254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502842, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.124@KRBTEST.COM for kudu/127.10.75.125@KRBTEST.COM
I20260812 02:47:22.661607 20535 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } } peers { permanent_uuid: "93f1b0eaa5b2471398af50fd531e703b" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } } peers { permanent_uuid: "b5f759956f1f4b44bedc37809c4a490b" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } }
I20260812 02:47:22.661864 20535 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f1b0eaa5b2471398af50fd531e703b, State: Initialized, Role: FOLLOWER
I20260812 02:47:22.662317 20535 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } } peers { permanent_uuid: "93f1b0eaa5b2471398af50fd531e703b" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } } peers { permanent_uuid: "b5f759956f1f4b44bedc37809c4a490b" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } }
I20260812 02:47:22.662817 20682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } } peers { permanent_uuid: "93f1b0eaa5b2471398af50fd531e703b" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } } peers { permanent_uuid: "b5f759956f1f4b44bedc37809c4a490b" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } } }
I20260812 02:47:22.663028 20682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:47:22.663677 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.653691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39130 (local address 127.10.75.125:45853)
0812 02:47:22.653816 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.653821 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.653833 (+ 12us) server_negotiation.cc:407] Connection header received
0812 02:47:22.653868 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.653871 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.653911 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.653982 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.654969 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.655474 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.656584 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.656935 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.657041 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.659374 (+ 2333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:22.659378 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:22.659381 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:22.659405 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:22.661179 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.661676 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.661680 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.661682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.661764 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.662117 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.662123 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.662128 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.662382 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:22.662487 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:22.662881 (+ 394us) server_negotiation.cc:299] Negotiation successful
0812 02:47:22.663014 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 02:47:22.663684 20535 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:47:22.664178 20674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.653393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.125:45853 (local address 127.0.0.1:39130)
0812 02:47:22.653531 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.653547 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 02:47:22.653632 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:47:22.654140 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:47:22.654146 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:47:22.654310 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:47:22.654861 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:22.654871 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.655593 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.655599 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:22.656476 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:22.656488 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.657161 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.657165 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:22.657251 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.657715 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:47:22.657731 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:47:22.659219 (+ 1488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:47:22.661306 (+ 2087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:22.661309 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:22.661310 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:22.661554 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:22.661889 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:22.661892 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:22.661894 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:22.661987 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:22.662553 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:47:22.662557 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:47:22.662659 (+ 102us) client_negotiation.cc:769] Sending connection context
0812 02:47:22.663884 (+ 1225us) client_negotiation.cc:240] Negotiation successful
0812 02:47:22.664025 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
Aug 12 02:47:22 dist-test-slave-2p8l krb5kdc[20254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.126@KRBTEST.COM
I20260812 02:47:22.664927 20670 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } has no permanent_uuid. Determining permanent_uuid...
I20260812 02:47:22.668932 20411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.659321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44466 (local address 127.10.75.126:36347)
0812 02:47:22.659428 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.659432 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.659488 (+ 56us) server_negotiation.cc:407] Connection header received
0812 02:47:22.659626 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.659629 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.659672 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.659773 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.660392 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.660933 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.661691 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.662004 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.662169 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.665080 (+ 2911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:22.665086 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:22.665089 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:22.665117 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:22.666974 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.667444 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.667448 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.667449 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.667545 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.667853 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.667858 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.667860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.668087 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:22.668270 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:22.668643 (+ 373us) server_negotiation.cc:299] Negotiation successful
0812 02:47:22.668762 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260812 02:47:22.669288 20702 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:47:22.669422 20702 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 12 02:47:22 dist-test-slave-2p8l krb5kdc[20254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502842, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.124@KRBTEST.COM for kudu/127.10.75.124@KRBTEST.COM
I20260812 02:47:22.667726 20414 master_runner.cc:186] Error getting master registration for 127.10.75.126:36347: OK, instance_id { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" instance_seqno: 1786502842154595 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 02:47:22.670842 20414 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 02:47:22.674675 20674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.665361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:37629 (local address 127.0.0.1:51100)
0812 02:47:22.665644 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.665658 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 02:47:22.665732 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:47:22.666363 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:47:22.666366 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:47:22.666537 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:47:22.666611 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:22.666618 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.667599 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.667605 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:22.668347 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:22.668357 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.668982 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.668985 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:22.669063 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.669553 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:47:22.669569 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:47:22.670965 (+ 1396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:47:22.672966 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:22.672969 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:22.672971 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:22.673208 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:22.673499 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:22.673510 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:22.673512 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:22.673609 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:22.674213 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:47:22.674216 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:47:22.674299 (+ 83us) client_negotiation.cc:769] Sending connection context
0812 02:47:22.674400 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 02:47:22.674519 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227}
I20260812 02:47:22.675273 20677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.665536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51100 (local address 127.10.75.124:37629)
0812 02:47:22.665633 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.665637 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.665697 (+ 60us) server_negotiation.cc:407] Connection header received
0812 02:47:22.665825 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.665828 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.665859 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.666256 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.666738 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.667471 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.668458 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.668792 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.668886 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.671101 (+ 2215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:22.671103 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:22.671105 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:22.671125 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:22.672856 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.673313 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.673316 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.673318 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.673397 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.673780 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.673784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.673786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.674077 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:22.674178 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:22.674997 (+ 819us) server_negotiation.cc:299] Negotiation successful
0812 02:47:22.675127 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
Aug 12 02:47:22 dist-test-slave-2p8l krb5kdc[20254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.75.125@KRBTEST.COM
I20260812 02:47:22.678210 20670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b: Bootstrap starting.
I20260812 02:47:22.680811 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.671823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39146 (local address 127.10.75.125:45853)
0812 02:47:22.671934 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.671938 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.671949 (+ 11us) server_negotiation.cc:407] Connection header received
0812 02:47:22.671982 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.671986 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.672028 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.672114 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.672699 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.673169 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.674129 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.674352 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.674465 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.677242 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:22.677246 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:22.677248 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:22.677274 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:22.678996 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.679507 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.679512 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.679515 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.679621 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.679941 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.679944 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.679946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.680158 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:22.680349 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:22.680546 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 02:47:22.680660 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 02:47:22.680826 20670 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b: Neither blocks nor log segments found. Creating new log.
I20260812 02:47:22.681667 20670 log.cc:824] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b: Log is configured to *not* fsync() on all Append() calls
I20260812 02:47:22.683859 20670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b: No bootstrap required, opened a new log
I20260812 02:47:22.684573 10541 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 02:47:22.687076 20670 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } } peers { permanent_uuid: "93f1b0eaa5b2471398af50fd531e703b" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } } peers { permanent_uuid: "b5f759956f1f4b44bedc37809c4a490b" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } }
I20260812 02:47:22.685950 20354 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "eef338bd7ad24c78aebabd15f942f48f"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44466
I20260812 02:47:22.687291 20670 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f759956f1f4b44bedc37809c4a490b, State: Initialized, Role: FOLLOWER
I20260812 02:47:22.687610 20670 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } } peers { permanent_uuid: "93f1b0eaa5b2471398af50fd531e703b" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } } peers { permanent_uuid: "b5f759956f1f4b44bedc37809c4a490b" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } }
I20260812 02:47:22.688083 20707 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } } peers { permanent_uuid: "93f1b0eaa5b2471398af50fd531e703b" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } } peers { permanent_uuid: "b5f759956f1f4b44bedc37809c4a490b" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } } }
I20260812 02:47:22.688223 20707 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:47:22.688829 20670 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b [sys.catalog]: configured and running, proceeding with master startup.
W20260812 02:47:22.693878 20730 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:47:22.694023 20730 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:47:22.692340 20546 master_runner.cc:186] Error getting master registration for 127.10.75.126:36347: OK, instance_id { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" instance_seqno: 1786502842154595 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 02:47:22.696069 20546 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 02:47:22.793254 20406 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } attempt: 4
Aug 12 02:47:22 dist-test-slave-2p8l krb5kdc[20254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786502842, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.75.126@KRBTEST.COM for kudu/127.10.75.124@KRBTEST.COM
I20260812 02:47:22.804484 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.793896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.75.124:37629 (local address 127.0.0.1:51116)
0812 02:47:22.794248 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0812 02:47:22.794268 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 02:47:22.794384 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 02:47:22.794984 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 02:47:22.794988 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 02:47:22.795235 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0812 02:47:22.795358 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:22.795365 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.796484 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.796488 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:22.797361 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 02:47:22.797378 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.798161 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.798165 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 02:47:22.798258 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.798866 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 02:47:22.798883 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 02:47:22.800511 (+ 1628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 02:47:22.802675 (+ 2164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:22.802679 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:22.802681 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:22.802945 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:22.803297 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 02:47:22.803300 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 02:47:22.803301 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 02:47:22.803392 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 02:47:22.803906 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 02:47:22.803912 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 02:47:22.804048 (+ 136us) client_negotiation.cc:769] Sending connection context
0812 02:47:22.804153 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 02:47:22.804303 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236}
I20260812 02:47:22.805119 20677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.794554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51116 (local address 127.10.75.124:37629)
0812 02:47:22.794718 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.794724 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.794743 (+ 19us) server_negotiation.cc:407] Connection header received
0812 02:47:22.794795 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.794798 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.794847 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.794938 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.795520 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.796337 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.797524 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.797873 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.797972 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.800688 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:22.800692 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:22.800694 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:22.800724 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:22.802536 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.803093 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.803096 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.803098 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.803186 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.803506 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.803510 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.803513 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.803761 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:22.803855 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:22.804826 (+ 971us) server_negotiation.cc:299] Negotiation successful
0812 02:47:22.804951 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 02:47:22.808830 20406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f: Bootstrap starting.
I20260812 02:47:22.812114 20406 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f: Neither blocks nor log segments found. Creating new log.
I20260812 02:47:22.813066 20406 log.cc:824] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f: Log is configured to *not* fsync() on all Append() calls
I20260812 02:47:22.815536 20406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f: No bootstrap required, opened a new log
I20260812 02:47:22.818863 20406 raft_consensus.cc:348] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } } peers { permanent_uuid: "93f1b0eaa5b2471398af50fd531e703b" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } } peers { permanent_uuid: "b5f759956f1f4b44bedc37809c4a490b" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } }
I20260812 02:47:22.819121 20406 raft_consensus.cc:729] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef338bd7ad24c78aebabd15f942f48f, State: Initialized, Role: FOLLOWER
I20260812 02:47:22.819468 20406 consensus_queue.cc:260] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } } peers { permanent_uuid: "93f1b0eaa5b2471398af50fd531e703b" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } } peers { permanent_uuid: "b5f759956f1f4b44bedc37809c4a490b" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } }
I20260812 02:47:22.820400 20735 sys_catalog.cc:455] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } } peers { permanent_uuid: "93f1b0eaa5b2471398af50fd531e703b" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } } peers { permanent_uuid: "b5f759956f1f4b44bedc37809c4a490b" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } } }
I20260812 02:47:22.820638 20735 sys_catalog.cc:458] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:47:22.820986 20406 sys_catalog.cc:564] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 02:47:22.821094 20354 raft_consensus.cc:482] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 02:47:22.821218 20354 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:47:22.822615 20354 raft_consensus.cc:504] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } } peers { permanent_uuid: "93f1b0eaa5b2471398af50fd531e703b" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } } peers { permanent_uuid: "b5f759956f1f4b44bedc37809c4a490b" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } }
I20260812 02:47:22.824368 20488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eef338bd7ad24c78aebabd15f942f48f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "93f1b0eaa5b2471398af50fd531e703b"
I20260812 02:47:22.824668 20488 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:47:22.826123 20488 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eef338bd7ad24c78aebabd15f942f48f in term 1.
I20260812 02:47:22.826730 20307 leader_election.cc:302] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93f1b0eaa5b2471398af50fd531e703b, eef338bd7ad24c78aebabd15f942f48f; no voters:
W20260812 02:47:22.827968 20757 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 02:47:22.828207 20757 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 02:47:22.828759 20354 leader_election.cc:288] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [CANDIDATE]: Term 1 election: Requested vote from peers 93f1b0eaa5b2471398af50fd531e703b (127.10.75.125:45853), b5f759956f1f4b44bedc37809c4a490b (127.10.75.124:37629)
I20260812 02:47:22.829078 20735 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 02:47:22.829352 20735 raft_consensus.cc:686] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [term 1 LEADER]: Becoming Leader. State: Replica: eef338bd7ad24c78aebabd15f942f48f, State: Running, Role: LEADER
I20260812 02:47:22.829752 20735 consensus_queue.cc:237] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } } peers { permanent_uuid: "93f1b0eaa5b2471398af50fd531e703b" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } } peers { permanent_uuid: "b5f759956f1f4b44bedc37809c4a490b" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } }
I20260812 02:47:22.831691 20626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eef338bd7ad24c78aebabd15f942f48f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b5f759956f1f4b44bedc37809c4a490b"
I20260812 02:47:22.831866 20735 sys_catalog.cc:455] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [sys.catalog]: SysCatalogTable state changed. Reason: New leader eef338bd7ad24c78aebabd15f942f48f. Latest consensus state: current_term: 1 leader_uuid: "eef338bd7ad24c78aebabd15f942f48f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } } peers { permanent_uuid: "93f1b0eaa5b2471398af50fd531e703b" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } } peers { permanent_uuid: "b5f759956f1f4b44bedc37809c4a490b" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } } }
I20260812 02:47:22.831972 20735 sys_catalog.cc:458] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:22.831955 20626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b [term 0 FOLLOWER]: Advancing to term 1
I20260812 02:47:22.833455 20626 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eef338bd7ad24c78aebabd15f942f48f in term 1.
I20260812 02:47:22.835953 20769 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 02:47:22.836989 20769 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 02:47:22.838460 20277 master_runner.cc:263] No leader master found from master eef338bd7ad24c78aebabd15f942f48f
I20260812 02:47:22.838591 20277 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 02:47:22.842849 20626 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b [term 1 FOLLOWER]: Refusing update from remote peer eef338bd7ad24c78aebabd15f942f48f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:47:22.843837 20759 consensus_queue.cc:1035] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f759956f1f4b44bedc37809c4a490b" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:47:22.848690 20707 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b [sys.catalog]: SysCatalogTable state changed. Reason: New leader eef338bd7ad24c78aebabd15f942f48f. Latest consensus state: current_term: 1 leader_uuid: "eef338bd7ad24c78aebabd15f942f48f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } } peers { permanent_uuid: "93f1b0eaa5b2471398af50fd531e703b" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } } peers { permanent_uuid: "b5f759956f1f4b44bedc37809c4a490b" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } } }
I20260812 02:47:22.848834 20707 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:47:22.849959 20488 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b [term 1 FOLLOWER]: Refusing update from remote peer eef338bd7ad24c78aebabd15f942f48f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 02:47:22.850605 20759 consensus_queue.cc:1035] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [LEADER]: Connected to new peer: Peer: permanent_uuid: "93f1b0eaa5b2471398af50fd531e703b" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 02:47:22.854686 20682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b [sys.catalog]: SysCatalogTable state changed. Reason: New leader eef338bd7ad24c78aebabd15f942f48f. Latest consensus state: current_term: 1 leader_uuid: "eef338bd7ad24c78aebabd15f942f48f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } } peers { permanent_uuid: "93f1b0eaa5b2471398af50fd531e703b" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } } peers { permanent_uuid: "b5f759956f1f4b44bedc37809c4a490b" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } } }
I20260812 02:47:22.854795 20682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:47:22.862313 20677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.840240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51130 (local address 127.10.75.124:37629)
0812 02:47:22.840357 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.840361 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.846358 (+ 5997us) server_negotiation.cc:407] Connection header received
0812 02:47:22.846571 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.846575 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.846629 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.846684 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.854182 (+ 7498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.854969 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.856287 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.856619 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.856728 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.858702 (+ 1974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:22.858706 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:22.858709 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:22.858738 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:22.860442 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.860919 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.860922 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.860924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.861050 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.861345 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.861348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.861350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.861548 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:22.861654 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:22.861996 (+ 342us) server_negotiation.cc:299] Negotiation successful
0812 02:47:22.862156 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 02:47:22.864990 20735 sys_catalog.cc:455] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eef338bd7ad24c78aebabd15f942f48f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } } peers { permanent_uuid: "93f1b0eaa5b2471398af50fd531e703b" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } } peers { permanent_uuid: "b5f759956f1f4b44bedc37809c4a490b" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } } }
I20260812 02:47:22.865152 20735 sys_catalog.cc:458] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:22.865494 20707 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eef338bd7ad24c78aebabd15f942f48f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } } peers { permanent_uuid: "93f1b0eaa5b2471398af50fd531e703b" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } } peers { permanent_uuid: "b5f759956f1f4b44bedc37809c4a490b" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } } }
I20260812 02:47:22.865621 20707 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:47:22.865666 20781 mvcc.cc:205] Tried to move back new op lower bound from 7317515644276150272 to 7317515644234883072. Current Snapshot: MvccSnapshot[applied={T|T < 7317515644276150272}]
I20260812 02:47:22.865859 20772 mvcc.cc:205] Tried to move back new op lower bound from 7317515644276150272 to 7317515644234883072. Current Snapshot: MvccSnapshot[applied={T|T < 7317515644276150272}]
W20260812 02:47:22.869705 20444 tablet.cc:2369] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 02:47:22.869869 20735 sys_catalog.cc:455] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eef338bd7ad24c78aebabd15f942f48f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } } peers { permanent_uuid: "93f1b0eaa5b2471398af50fd531e703b" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } } peers { permanent_uuid: "b5f759956f1f4b44bedc37809c4a490b" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } } }
I20260812 02:47:22.869984 20735 sys_catalog.cc:458] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f [sys.catalog]: This master's current role is: LEADER
I20260812 02:47:22.871148 20682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eef338bd7ad24c78aebabd15f942f48f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eef338bd7ad24c78aebabd15f942f48f" member_type: VOTER last_known_addr { host: "127.10.75.126" port: 36347 } } peers { permanent_uuid: "93f1b0eaa5b2471398af50fd531e703b" member_type: VOTER last_known_addr { host: "127.10.75.125" port: 45853 } } peers { permanent_uuid: "b5f759956f1f4b44bedc37809c4a490b" member_type: VOTER last_known_addr { host: "127.10.75.124" port: 37629 } } }
I20260812 02:47:22.871268 20682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 02:47:22.873123 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.842084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39160 (local address 127.10.75.125:45853)
0812 02:47:22.842194 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.842199 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.857916 (+ 15717us) server_negotiation.cc:407] Connection header received
0812 02:47:22.858119 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.858123 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.858174 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.858225 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.861092 (+ 2867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.861839 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.863006 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.863328 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.863427 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.867049 (+ 3622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:22.867053 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:22.867056 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:22.867084 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:22.868824 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.871781 (+ 2957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.871785 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.871787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.871876 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.872181 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.872185 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.872187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.872393 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:22.872499 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:22.872832 (+ 333us) server_negotiation.cc:299] Negotiation successful
0812 02:47:22.872960 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 02:47:22.874853 20784 mvcc.cc:205] Tried to move back new op lower bound from 7317515644276150272 to 7317515644234883072. Current Snapshot: MvccSnapshot[applied={T|T < 7317515644276150272}]
I20260812 02:47:22.875385 20411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:22.841405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44472 (local address 127.10.75.126:36347)
0812 02:47:22.841538 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.841543 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.856483 (+ 14940us) server_negotiation.cc:407] Connection header received
0812 02:47:22.856668 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.856672 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.856723 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.856773 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.859094 (+ 2321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.859857 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.863033 (+ 3176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:22.863344 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:22.863427 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:22.871598 (+ 8171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 02:47:22.871603 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 02:47:22.871605 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 02:47:22.871635 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 02:47:22.873382 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.873896 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.873900 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.873902 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.873997 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 02:47:22.874398 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 02:47:22.874402 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 02:47:22.874403 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 02:47:22.874618 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 02:47:22.874726 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:22.875098 (+ 372us) server_negotiation.cc:299] Negotiation successful
0812 02:47:22.875225 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 02:47:22.877125 20769 catalog_manager.cc:1347] Generated new cluster ID: 8871dd774f2247ee8708f65a2f159acc
I20260812 02:47:22.877215 20769 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 02:47:22.896061 20769 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 02:47:22.897334 20769 catalog_manager.cc:1504] Loading token signing keys...
I20260812 02:47:22.907414 20769 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eef338bd7ad24c78aebabd15f942f48f: Generated new TSK 0
I20260812 02:47:22.908319 20769 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 02:47:22.935520 20411 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:22.933462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44488 (local address 127.10.75.126:36347)
0812 02:47:22.933632 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.933637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.934330 (+ 693us) server_negotiation.cc:407] Connection header received
0812 02:47:22.934539 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.934543 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.934601 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.934661 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.935377 (+ 716us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44488: BlockingRecv error: recv got EOF from 127.0.0.1:44488 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260812 02:47:22.935542 20677 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:22.933867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51138 (local address 127.10.75.124:37629)
0812 02:47:22.933987 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.933991 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.934363 (+ 372us) server_negotiation.cc:407] Connection header received
0812 02:47:22.934575 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.934579 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.934634 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.934688 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.935406 (+ 718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51138: BlockingRecv error: recv got EOF from 127.0.0.1:51138 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260812 02:47:22.935603 20544 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:22.933969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39168 (local address 127.10.75.125:45853)
0812 02:47:22.934141 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.934147 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.934360 (+ 213us) server_negotiation.cc:407] Connection header received
0812 02:47:22.934584 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.934587 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.934634 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.934688 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.935406 (+ 718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39168: BlockingRecv error: recv got EOF from 127.0.0.1:39168 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260812 02:47:22.939124 20544 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:22.937969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39180 (local address 127.10.75.125:45853)
0812 02:47:22.938111 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.938115 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.938248 (+ 133us) server_negotiation.cc:407] Connection header received
0812 02:47:22.938382 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.938386 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.938469 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.938561 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.938997 (+ 436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39180: BlockingRecv error: recv got EOF from 127.0.0.1:39180 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260812 02:47:22.943300 20544 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:22.942446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39184 (local address 127.10.75.125:45853)
0812 02:47:22.942587 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.942594 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.942609 (+ 15us) server_negotiation.cc:407] Connection header received
0812 02:47:22.942658 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.942661 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.942709 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.942790 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.943190 (+ 400us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39184: BlockingRecv error: recv got EOF from 127.0.0.1:39184 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260812 02:47:22.948422 20544 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:22.947326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39194 (local address 127.10.75.125:45853)
0812 02:47:22.947442 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.947447 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.947570 (+ 123us) server_negotiation.cc:407] Connection header received
0812 02:47:22.947677 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.947679 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.947727 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.947796 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.948277 (+ 481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39194: BlockingRecv error: recv got EOF from 127.0.0.1:39194 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260812 02:47:22.955307 20544 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:22.954320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39198 (local address 127.10.75.125:45853)
0812 02:47:22.954448 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.954452 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.954627 (+ 175us) server_negotiation.cc:407] Connection header received
0812 02:47:22.954711 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.954714 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.954764 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.954848 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.955210 (+ 362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39198: BlockingRecv error: recv got EOF from 127.0.0.1:39198 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260812 02:47:22.966696 20544 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:22.965477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39214 (local address 127.10.75.125:45853)
0812 02:47:22.965622 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.965627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.965808 (+ 181us) server_negotiation.cc:407] Connection header received
0812 02:47:22.965905 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.965909 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.965968 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.966105 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.966568 (+ 463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39214: BlockingRecv error: recv got EOF from 127.0.0.1:39214 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260812 02:47:22.986263 20544 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:22.985026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39230 (local address 127.10.75.125:45853)
0812 02:47:22.985195 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:22.985200 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:22.985319 (+ 119us) server_negotiation.cc:407] Connection header received
0812 02:47:22.985432 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:22.985436 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:22.985501 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:22.985614 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:22.986137 (+ 523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39230: BlockingRecv error: recv got EOF from 127.0.0.1:39230 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260812 02:47:23.021726 20544 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:23.020465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39242 (local address 127.10.75.125:45853)
0812 02:47:23.020615 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:23.020620 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:23.020735 (+ 115us) server_negotiation.cc:407] Connection header received
0812 02:47:23.020920 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:23.020924 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:23.020988 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:23.021118 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:23.021590 (+ 472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39242: BlockingRecv error: recv got EOF from 127.0.0.1:39242 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260812 02:47:23.089879 20544 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:23.088251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39250 (local address 127.10.75.125:45853)
0812 02:47:23.088470 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:23.088475 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:23.088778 (+ 303us) server_negotiation.cc:407] Connection header received
0812 02:47:23.088964 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:23.088968 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:23.089030 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:23.089134 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:23.089729 (+ 595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39250: BlockingRecv error: recv got EOF from 127.0.0.1:39250 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
W20260812 02:47:23.164021 20392 messenger.cc:188] Invalid argument: socket address is ambiguous: no data on pending connections for acceptor pool at 127.10.75.126:36347
W20260812 02:47:23.221722 20544 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:23.220371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39266 (local address 127.10.75.125:45853)
0812 02:47:23.220525 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:23.220530 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:23.220709 (+ 179us) server_negotiation.cc:407] Connection header received
0812 02:47:23.220914 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:23.220917 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:23.220967 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:23.221081 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:23.221580 (+ 499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39266: BlockingRecv error: recv got EOF from 127.0.0.1:39266 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260812 02:47:23.481195 20544 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 02:47:23.480089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39272 (local address 127.10.75.125:45853)
0812 02:47:23.480249 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:23.480253 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:23.480326 (+ 73us) server_negotiation.cc:407] Connection header received
0812 02:47:23.480448 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:23.480451 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:23.480500 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:23.480574 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 02:47:23.481063 (+ 489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39272: BlockingRecv error: recv got EOF from 127.0.0.1:39272 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 02:47:23.670921 20702 catalog_manager.cc:1259] Loaded cluster ID: 8871dd774f2247ee8708f65a2f159acc
I20260812 02:47:23.671016 20702 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b: loading cluster ID for follower catalog manager: success
I20260812 02:47:23.672801 20702 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b: acquiring CA information for follower catalog manager: success
I20260812 02:47:23.674026 20702 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 93f1b0eaa5b2471398af50fd531e703b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 02:47:23.695890 20730 catalog_manager.cc:1259] Loaded cluster ID: 8871dd774f2247ee8708f65a2f159acc
I20260812 02:47:23.696010 20730 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b: loading cluster ID for follower catalog manager: success
I20260812 02:47:23.697932 20730 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b: acquiring CA information for follower catalog manager: success
I20260812 02:47:23.699410 20730 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b5f759956f1f4b44bedc37809c4a490b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 02:47:24.000533 20924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:23.995929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39284 (local address 127.10.75.125:45853)
0812 02:47:23.996231 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:23.996235 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:23.996303 (+ 68us) server_negotiation.cc:407] Connection header received
0812 02:47:23.996471 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:23.996474 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:23.996649 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:23.996785 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:47:23.997060 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:23.997641 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:23.998739 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:23.999013 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:23.999105 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:23.999462 (+ 357us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:47:24.000108 (+ 646us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:47:24.000218 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:24.000275 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 02:47:24.000349 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":112,"threads_started":1}
I20260812 02:47:24.009269 20941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:24.004813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51150 (local address 127.10.75.124:37629)
0812 02:47:24.005128 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:24.005132 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:24.005147 (+ 15us) server_negotiation.cc:407] Connection header received
0812 02:47:24.005260 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:24.005263 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:24.005435 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:24.005564 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:47:24.005831 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:24.006496 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:24.007481 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:24.007718 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:24.007820 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:24.008197 (+ 377us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:47:24.008790 (+ 593us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:47:24.008905 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:24.009035 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 02:47:24.009103 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":139,"threads_started":1}
I20260812 02:47:24.017591 20941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:24.013183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51158 (local address 127.10.75.124:37629)
0812 02:47:24.013432 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:24.013438 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:24.013683 (+ 245us) server_negotiation.cc:407] Connection header received
0812 02:47:24.013878 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:24.013884 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:24.013960 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:24.014003 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:47:24.014387 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:24.015237 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:24.016289 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:24.016557 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:24.016673 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:24.016969 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:47:24.017076 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:47:24.017174 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:24.017311 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 02:47:24.017383 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
I20260812 02:47:24.017810 20924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:24.013805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39298 (local address 127.10.75.125:45853)
0812 02:47:24.014010 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:24.014014 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:24.014026 (+ 12us) server_negotiation.cc:407] Connection header received
0812 02:47:24.014139 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:24.014141 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:24.014195 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:24.014285 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:47:24.014546 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:24.015323 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:24.016567 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:24.016912 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:24.017037 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:24.017279 (+ 242us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:47:24.017384 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:47:24.017456 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:24.017586 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 02:47:24.017659 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260812 02:47:24.018744 20955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 02:47:24.013147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44502 (local address 127.10.75.126:36347)
0812 02:47:24.013461 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0812 02:47:24.013466 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 02:47:24.013482 (+ 16us) server_negotiation.cc:407] Connection header received
0812 02:47:24.013705 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 02:47:24.013709 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 02:47:24.014495 (+ 786us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 02:47:24.014655 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 02:47:24.014897 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:24.015566 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:24.016755 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 02:47:24.017168 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 02:47:24.017308 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 02:47:24.017663 (+ 355us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 02:47:24.018225 (+ 562us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 02:47:24.018323 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 02:47:24.018458 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 02:47:24.018538 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":90,"threads_started":1}
I20260812 02:47:24.026679 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 20277
I20260812 02:47:24.068074 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 20414
I20260812 02:47:24.095468 10541 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWpp1yo/build/debug/bin/kudu with pid 20546
2026-08-12T02:47:24Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3614 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (7042 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (304394 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST